[ 543.751937] env[65540]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 543.751937] env[65540]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 544.753757] env[65630]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 544.753757] env[65630]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 546.312336] env[65630]: INFO neutron.common.config [-] Logging enabled! [ 546.312697] env[65630]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev60 [ 546.312884] env[65630]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65630) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 546.313203] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 546.313551] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 546.314111] env[65630]: WARNING oslo_policy.policy [None req-6d120f21-8511-476e-a76c-eaef149693af None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 546.314328] env[65630]: WARNING oslo_policy.policy [None req-6d120f21-8511-476e-a76c-eaef149693af None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 546.315956] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-6d120f21-8511-476e-a76c-eaef149693af None None] VMware NSXv3 Agent initialized successfully. [ 546.316322] env[65630]: DEBUG oslo_concurrency.lockutils [None req-6d120f21-8511-476e-a76c-eaef149693af None None] Acquiring lock "singleton_lock" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.316450] env[65630]: DEBUG oslo_concurrency.lockutils [None req-6d120f21-8511-476e-a76c-eaef149693af None None] Acquired lock "singleton_lock" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.316660] env[65630]: DEBUG oslo_concurrency.lockutils [None req-6d120f21-8511-476e-a76c-eaef149693af None None] Releasing lock "singleton_lock" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.316945] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] Full set of CONF: {{(pid=65630) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 546.317070] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ******************************************************************************** {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 546.317172] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] Configuration options gathered from: {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 546.317512] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 546.317684] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 546.317791] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ================================================================================ {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 546.317955] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] agent_down_time = 75 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.318105] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] allow_automatic_dhcp_failover = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.318245] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] allow_bulk = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.318402] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] api_extensions_path = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.318558] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] api_paste_config = api-paste.ini {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.318702] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] auth_strategy = keystone {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.318808] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] backdoor_port = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.318911] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] backdoor_socket = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.319057] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] backlog = 4096 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.319197] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] base_mac = fa:16:3e:00:00:00 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.319393] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] bind_host = 0.0.0.0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.319546] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] bind_port = 9696 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.319647] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] client_socket_timeout = 900 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.319787] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] config_dir = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.319894] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.320040] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] config_source = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.320185] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] control_exchange = neutron {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.320327] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] core_plugin = ml2 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.320468] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] debug = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.320608] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] default_availability_zones = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.320870] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.321053] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] dhcp_agent_notification = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.321197] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] dhcp_agents_per_network = 1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.321332] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] dhcp_lease_duration = 86400 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.321479] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] dhcp_load_type = networks {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.321622] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] dns_domain = openstacklocal {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.321759] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.321893] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] enable_default_route_bfd = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322033] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] enable_default_route_ecmp = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322168] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] enable_dvr = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322300] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] enable_new_agents = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322431] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322562] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] enable_signals = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322689] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] enable_traditional_dhcp = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322813] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] external_dns_driver = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.322941] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] filter_validation = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.323090] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] global_physnet_mtu = 8950 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.323220] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] graceful_shutdown_timeout = 60 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.323389] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] host = cpu-1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.323527] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] host_dvr_for_dhcp = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.323656] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] http_retries = 3 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.323792] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] instance_format = [instance: %(uuid)s] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.323946] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.324157] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ipam_driver = internal {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.324302] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ipv6_pd_enabled = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.324435] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] l3_ha = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.324577] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.324709] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] l3_ha_network_physical_name = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.324847] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] l3_ha_network_type = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.324977] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_color = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.325120] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_config_append = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.325256] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.325386] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_dir = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.325516] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_file = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.325618] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_options = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.325748] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_rotate_interval = 1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.325885] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_rotate_interval_type = days {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326026] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] log_rotation_type = none {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326130] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326228] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326362] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326496] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326593] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326721] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] max_dns_nameservers = 5 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326852] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] max_header_line = 16384 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.326976] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] max_l3_agents_per_router = 3 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.327166] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] max_logfile_count = 30 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.327319] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] max_logfile_size_mb = 200 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.327454] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] max_subnet_host_routes = 20 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.327593] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] my_ip = 10.180.1.21 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.327727] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] my_ipv6 = ::1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.327855] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] network_auto_schedule = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.327979] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] network_link_prefix = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.328128] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.328266] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] notify_nova_on_port_data_changes = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.328427] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] notify_nova_on_port_status_changes = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.328569] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] pagination_max_limit = -1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.328766] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] publish_errors = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.328900] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] rate_limit_burst = 0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329048] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] rate_limit_except_level = CRITICAL {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329181] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] rate_limit_interval = 0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329309] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] retry_until_window = 30 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329438] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] router_distributed = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329595] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] rpc_resources_processing_step = 20 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329731] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] rpc_response_max_timeout = 600 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329866] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] rpc_response_timeout = 60 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.329996] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] send_events_interval = 2 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.330158] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] service_plugins = ['router'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.330296] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] setproctitle = on {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.330426] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] shell_completion = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.330561] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] state_path = /opt/stack/data/neutron {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.330715] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] syslog_log_facility = LOG_USER {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.330849] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] tcp_keepidle = 600 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.330991] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] transport_url = **** {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.331136] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] use_journal = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.331266] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] use_json = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.331396] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] use_ssl = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.331528] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] use_stderr = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.331664] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] use_syslog = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.331792] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] vlan_qinq = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.331917] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] vlan_transparent = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.332057] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] watch_log_file = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.332188] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] wsgi_default_pool_size = 100 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.332315] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] wsgi_keep_alive = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.332450] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.332580] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] wsgi_server_debug = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.332743] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_concurrency.disable_process_locking = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.332876] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.333029] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.333168] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.333305] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.333443] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.333581] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.333727] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.connection_string = messaging:// {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.333868] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.enabled = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334015] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.es_doc_type = notification {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334157] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.es_scroll_size = 10000 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334295] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.es_scroll_time = 2m {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334430] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.filter_error_trace = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334568] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.hmac_keys = **** {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334705] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.sentinel_service_name = mymaster {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334849] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.socket_timeout = 0.1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.334982] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.trace_requests = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.335126] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler.trace_sqlalchemy = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.335273] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler_jaeger.process_tags = {} {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.335405] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler_jaeger.service_name_prefix = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.335539] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] profiler_otlp.service_name_prefix = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.335686] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.enforce_new_defaults = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.335957] env[65630]: WARNING oslo_config.cfg [None req-6d120f21-8511-476e-a76c-eaef149693af None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 546.336120] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.enforce_scope = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.336266] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.policy_default_rule = default {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.336422] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.336564] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.336709] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.336845] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.336977] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.337121] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.337256] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.337396] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_policy.remote_timeout = 60.0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.337545] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.337692] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] agent.extensions = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.337839] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.337973] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] service_providers.service_provider = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.338126] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.default_quota = -1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.338268] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.338428] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_floatingip = 50 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.338577] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_network = 100 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.338778] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_port = 500 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.339012] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.339214] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_router = 10 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.339384] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_security_group = 10 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.339552] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.339697] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.quota_subnet = 100 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.339833] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] QUOTAS.track_quota_usage = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.339986] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.340134] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep.group = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.340266] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep.helper_command = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.340398] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep.log_daemon_traceback = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.340539] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.340700] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep.thread_pool_size = 8 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.340803] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep.user = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.340951] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.341143] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_dhcp_release.group = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.341286] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_dhcp_release.helper_command = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.341422] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.341565] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.341695] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.341825] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_dhcp_release.user = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.341964] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.342105] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_ovs_vsctl.group = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.342248] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_ovs_vsctl.helper_command = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.342401] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.342566] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.342717] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.342851] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_ovs_vsctl.user = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.342990] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_namespace.capabilities = [21] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.343158] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_namespace.group = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.343318] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_namespace.helper_command = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.343460] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_namespace.log_daemon_traceback = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.343602] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.343736] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_namespace.thread_pool_size = 8 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.343864] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_namespace.user = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344029] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_conntrack.capabilities = [12] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344145] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_conntrack.group = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344273] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_conntrack.helper_command = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344405] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344542] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344674] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344803] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_conntrack.user = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.344939] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_link.capabilities = [12, 21] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.345078] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_link.group = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.345209] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_link.helper_command = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.345351] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_link.log_daemon_traceback = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.345519] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.345664] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_link.thread_pool_size = 8 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.345803] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] privsep_link.user = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.345954] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.346128] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.346345] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.continue_on_failed_promotions = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.346549] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.dscp = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.346707] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.dscp_inherit = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.346857] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.force_mp_to_policy = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.346996] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.locking_coordinator_url = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.347150] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.log_agent_heartbeats = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.347302] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.logging_expire = 1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.347457] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.347611] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.347777] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.polling_interval = 240 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.347921] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.348080] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.348231] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.report_interval = 30.0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.348422] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.348581] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.348730] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.348869] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.sync_skew = 60 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.349015] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.synchronization_queue_size = 20 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.349163] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT.use_helper_for_ns_read = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.349310] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] SECURITYGROUP.enable_ipset = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.349462] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] SECURITYGROUP.enable_security_group = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.349622] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.349766] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.349909] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] experimental.ipv6_pd_enabled = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.350079] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.extension_drivers = ['port_security'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.350219] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.external_network_type = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.350371] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.350517] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.overlay_ip_version = 4 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.350655] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.path_mtu = 8950 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.350797] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.physical_network_mtus = {} {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.350943] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.tenant_network_types = ['vlan'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.351099] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.351246] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ml2.type_drivers = ['vlan'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.351394] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT_CLI.neutron_port_id = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.351531] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.351664] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.351809] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.351952] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.352104] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.352246] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.352387] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.352530] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.352726] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.352870] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_login_password = **** {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353022] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_login_port = 443 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353161] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_login_user = admin {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353300] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353442] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353582] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353711] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353848] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.353993] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.354149] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.354289] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.354427] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.354570] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.354716] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.354853] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.354991] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.355193] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.355341] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] vsphere.vsphere_login_password = VMware1! {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.355482] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.355622] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.355763] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.auth_section = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.355909] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.auth_type = password {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.356057] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.356192] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.certfile = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.356329] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.collect_timing = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.356473] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.endpoint_type = public {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.356608] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.insecure = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.356734] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.keyfile = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.356873] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.region_name = RegionOne {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357015] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.split_loggers = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357150] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] nova.timeout = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357287] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.auth_section = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357427] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.auth_type = password {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357566] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357700] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.certfile = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357830] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.collect_timing = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.357968] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.endpoint_type = public {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.358111] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.insecure = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.358234] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.keyfile = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.358380] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.region_name = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.358526] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.split_loggers = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.358659] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] placement.timeout = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.358794] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.auth_section = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.358928] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.auth_type = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.359069] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.cafile = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.359198] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.certfile = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.359331] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.collect_timing = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.359465] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.connect_retries = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.359622] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.connect_retry_delay = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.359760] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.enable_notifications = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.359896] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.endpoint_override = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360042] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.insecure = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360177] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.interface = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360305] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.keyfile = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360440] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.max_version = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360570] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.min_version = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360703] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.region_name = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360832] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.retriable_status_codes = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.360962] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.service_name = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.361103] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.service_type = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.361239] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.split_loggers = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.361372] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.status_code_retries = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.361506] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.status_code_retry_delay = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.361639] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.timeout = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.361770] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.valid_interfaces = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.361901] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ironic.version = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.362053] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] cli_script.dry_run = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.362201] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.362338] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.362475] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.362613] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.362746] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.362880] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363022] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363157] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363290] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363433] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363566] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363708] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363847] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.363987] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.364137] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.364279] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.364413] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.364556] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.364694] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.364828] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.364961] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.365107] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.365240] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.365374] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.365507] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.365642] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.365773] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.365907] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.366048] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.366186] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.366319] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.ssl = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.366486] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.366635] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.366770] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.366913] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.367066] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.ssl_version = {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.367205] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.367350] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_notifications.driver = [] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.367490] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_notifications.retry = -1 {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.367639] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.367772] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] oslo_messaging_notifications.transport_url = **** {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.367875] env[65630]: DEBUG oslo_service.backend._eventlet.service [None req-6d120f21-8511-476e-a76c-eaef149693af None None] ******************************************************************************** {{(pid=65630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 546.369047] env[65630]: DEBUG neutron.agent.securitygroups_rpc [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Init firewall settings (driver=nsxv3) {{(pid=65630) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 546.370364] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65630) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 546.370599] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] RPC agent_id: nsxm-l-01a.corp.local [ 546.372810] env[65630]: DEBUG dogpile.cache.region [None req-5d364453-b283-467b-8307-5e17fe017293 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 546.372924] env[65630]: DEBUG dogpile.lock [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 546.373037] env[65630]: DEBUG dogpile.lock [None req-5d364453-b283-467b-8307-5e17fe017293 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 546.373127] env[65630]: DEBUG dogpile.lock [None req-5d364453-b283-467b-8307-5e17fe017293 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 546.373219] env[65630]: DEBUG dogpile.cache.region [None req-5d364453-b283-467b-8307-5e17fe017293 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 546.373304] env[65630]: DEBUG dogpile.lock [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 546.373425] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 546.405195] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Session token - acquiring [ 546.406695] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.406865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.406996] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.407414] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.419387] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.705617] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 546.726544] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 546.726769] env[65630]: DEBUG dogpile.cache.region [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Cache value generated in 0.353 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 546.726810] env[65630]: DEBUG dogpile.lock [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 546.726913] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Activating Policy API Provider. [ 546.727116] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Looking for the default Infrastructure Rules. [ 546.793440] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Looking for the Default Layer3 Logged Drop Section. [ 546.808132] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 546.808671] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.808836] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.808926] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.809233] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.809615] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-5d364453-b283-467b-8307-5e17fe017293 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.324140] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-5d364453-b283-467b-8307-5e17fe017293 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.826672] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-5d364453-b283-467b-8307-5e17fe017293 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.328797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Inventory metadata is going to be refreshed. [ 548.329280] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 549.142629] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.142977] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.142977] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.143307] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.154946] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 549.157181] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.157970] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 549.179469] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.179734] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.179734] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.180049] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.180177] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.180335] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 549.180445] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.180546] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 549.202084] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.202344] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.202344] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.202583] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.202752] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.202897] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 549.226012] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.226381] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.226481] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.226813] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.226958] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.227121] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 549.250531] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.250859] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.250859] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.251098] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.251232] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.251385] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 549.251478] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.251577] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 549.273478] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.273768] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.273768] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.274090] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.274216] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.274360] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 549.274462] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.274565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 549.295425] env[65630]: DEBUG networking_nsxv3.common.locking [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.295684] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.295684] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.295972] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.296131] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.296279] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 549.296390] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.296488] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Inventory metadata have been refreshed. [ 549.296582] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Dryrun:True. Metadata refresh completed. [ 549.296696] env[65630]: DEBUG oslo_concurrency.lockutils [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Releasing lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.298544] env[65630]: INFO neutron.agent.agent_extensions_manager [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Loaded agent extensions: [] [ 549.299309] env[65630]: DEBUG neutron_lib.callbacks.manager [None req-5d364453-b283-467b-8307-5e17fe017293 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65630) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 549.354157] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent RPC Daemon Started! [ 549.354585] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent loop - iteration:0 started [ 549.354585] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent out of sync with plugin! [ 554.300444] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 554.300954] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 559.302185] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 559.302514] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 564.295305] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1f1b172b-1959-42ce-affd-25cdbdba9ba0 demo admin] Enqueued Resource ID: 3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718 with Priority: HIGHEST for action security_group_rules [ 564.295755] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718 with Priority: HIGHEST for action security_group_rules [ 564.297613] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.297784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.297881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.298269] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.298409] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.819130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.819343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.819343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.819526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.819583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.819696] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718 already deleted. [ 564.819816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8bf93f-3fbe-42cf-aee3-d0e3fc0c0718" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.297437] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 569.297889] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.298724] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 574.299282] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 579.300406] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 579.301118] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 584.303433] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 584.303941] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 589.305058] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 589.305407] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 592.287839] env[65630]: INFO networking_nsxv3.common.synchronization [None req-89a2d7b4-80bb-4c93-b8e5-b9583da4db34 None None] Enqueued Resource ID: 210bb593-c3a3-4681-9468-3655c1ec25f7 with Priority: HIGHEST for action port [ 592.288168] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210bb593-c3a3-4681-9468-3655c1ec25f7 with Priority: HIGHEST for action port [ 592.289350] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-210bb593-c3a3-4681-9468-3655c1ec25f7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.289536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-210bb593-c3a3-4681-9468-3655c1ec25f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.289536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-210bb593-c3a3-4681-9468-3655c1ec25f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.289794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-210bb593-c3a3-4681-9468-3655c1ec25f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.289877] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('210bb593-c3a3-4681-9468-3655c1ec25f7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.793100] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 210bb593-c3a3-4681-9468-3655c1ec25f7 [ 592.793100] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.793320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.793320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.793527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.793618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.793712] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:210bb593-c3a3-4681-9468-3655c1ec25f7 already deleted. [ 592.793793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-210bb593-c3a3-4681-9468-3655c1ec25f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.146851] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e72b86a4-2a5b-4c7e-b523-3efc85bfd99b None None] Enqueued Resource ID: 73d74bbf-bd31-485b-8309-1119ed93c46b with Priority: HIGHEST for action port [ 594.147141] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73d74bbf-bd31-485b-8309-1119ed93c46b with Priority: HIGHEST for action port [ 594.147724] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-73d74bbf-bd31-485b-8309-1119ed93c46b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.147850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73d74bbf-bd31-485b-8309-1119ed93c46b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.147944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73d74bbf-bd31-485b-8309-1119ed93c46b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.148642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73d74bbf-bd31-485b-8309-1119ed93c46b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.148729] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73d74bbf-bd31-485b-8309-1119ed93c46b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.652338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73d74bbf-bd31-485b-8309-1119ed93c46b [ 594.652451] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.652508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.652577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.652800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.652892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.652986] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73d74bbf-bd31-485b-8309-1119ed93c46b already deleted. [ 594.653081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73d74bbf-bd31-485b-8309-1119ed93c46b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.378946] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7718c750-ff88-4094-9331-8d059c723abc None None] Enqueued Resource ID: 2796d062-88b6-491c-9392-6e187f73e7bf with Priority: HIGHEST for action port [ 595.379249] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2796d062-88b6-491c-9392-6e187f73e7bf with Priority: HIGHEST for action port [ 595.379719] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2796d062-88b6-491c-9392-6e187f73e7bf taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.380087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2796d062-88b6-491c-9392-6e187f73e7bf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.380087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2796d062-88b6-491c-9392-6e187f73e7bf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.380251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2796d062-88b6-491c-9392-6e187f73e7bf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.380293] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2796d062-88b6-491c-9392-6e187f73e7bf',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.675548] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a243acee-63d9-406e-ae48-75db421cbff3 None None] Enqueued Resource ID: de4028eb-e232-4cb2-885b-1a1d66364ef9 with Priority: HIGHEST for action port [ 595.676599] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4028eb-e232-4cb2-885b-1a1d66364ef9 with Priority: HIGHEST for action port [ 595.677457] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-de4028eb-e232-4cb2-885b-1a1d66364ef9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.677692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de4028eb-e232-4cb2-885b-1a1d66364ef9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.678244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de4028eb-e232-4cb2-885b-1a1d66364ef9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.680944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de4028eb-e232-4cb2-885b-1a1d66364ef9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.680944] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de4028eb-e232-4cb2-885b-1a1d66364ef9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.884406] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2796d062-88b6-491c-9392-6e187f73e7bf [ 595.884406] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.884406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.884406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.884406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.884406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.884406] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2796d062-88b6-491c-9392-6e187f73e7bf already deleted. [ 595.884406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2796d062-88b6-491c-9392-6e187f73e7bf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.185683] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de4028eb-e232-4cb2-885b-1a1d66364ef9 [ 596.186087] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.186257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.186367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.186647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.187439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.187859] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de4028eb-e232-4cb2-885b-1a1d66364ef9 already deleted. [ 596.187859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de4028eb-e232-4cb2-885b-1a1d66364ef9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.688359] env[65630]: INFO networking_nsxv3.common.synchronization [None req-d3c487ab-ab3d-4201-ba57-fc74a85f9b6f None None] Enqueued Resource ID: b62be3b7-d208-4a40-96b7-1f5882100c69 with Priority: HIGHEST for action port [ 596.689264] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62be3b7-d208-4a40-96b7-1f5882100c69 with Priority: HIGHEST for action port [ 596.689264] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b62be3b7-d208-4a40-96b7-1f5882100c69 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.689420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b62be3b7-d208-4a40-96b7-1f5882100c69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.689420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b62be3b7-d208-4a40-96b7-1f5882100c69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.689619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b62be3b7-d208-4a40-96b7-1f5882100c69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.689904] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b62be3b7-d208-4a40-96b7-1f5882100c69',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.193875] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b62be3b7-d208-4a40-96b7-1f5882100c69 [ 597.194130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.194268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.194357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.194598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.194691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.194784] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b62be3b7-d208-4a40-96b7-1f5882100c69 already deleted. [ 597.194866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b62be3b7-d208-4a40-96b7-1f5882100c69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.312233] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b655c8d0-f663-415d-a8fd-1b9f65c9e574 None None] Enqueued Resource ID: afc6344b-3372-4bb9-9211-b203f8d06631 with Priority: HIGHEST for action port [ 597.312765] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc6344b-3372-4bb9-9211-b203f8d06631 with Priority: HIGHEST for action port [ 597.315058] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-afc6344b-3372-4bb9-9211-b203f8d06631 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.315058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afc6344b-3372-4bb9-9211-b203f8d06631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.315058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afc6344b-3372-4bb9-9211-b203f8d06631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.315058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afc6344b-3372-4bb9-9211-b203f8d06631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.315058] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afc6344b-3372-4bb9-9211-b203f8d06631',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.817878] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afc6344b-3372-4bb9-9211-b203f8d06631 [ 597.818725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.818725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.818725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.820274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.820274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.820274] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afc6344b-3372-4bb9-9211-b203f8d06631 already deleted. [ 597.820274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afc6344b-3372-4bb9-9211-b203f8d06631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.025173] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1cf417d4-847a-4f31-9829-4569fddfe6f2 None None] Enqueued Resource ID: c7badc13-9d4e-4301-bc04-ff5704ab29d9 with Priority: HIGHEST for action port [ 598.025436] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7badc13-9d4e-4301-bc04-ff5704ab29d9 with Priority: HIGHEST for action port [ 598.026131] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7badc13-9d4e-4301-bc04-ff5704ab29d9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.026192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7badc13-9d4e-4301-bc04-ff5704ab29d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.026225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7badc13-9d4e-4301-bc04-ff5704ab29d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.026865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7badc13-9d4e-4301-bc04-ff5704ab29d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.026865] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7badc13-9d4e-4301-bc04-ff5704ab29d9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.127760] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b36ef68f-012d-47f5-bce6-289eb2233a3e None None] Enqueued Resource ID: e2bb007b-745b-49fa-baa8-ff6e583b695a with Priority: HIGHEST for action port [ 598.129323] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bb007b-745b-49fa-baa8-ff6e583b695a with Priority: HIGHEST for action port [ 598.130167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2bb007b-745b-49fa-baa8-ff6e583b695a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.130984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2bb007b-745b-49fa-baa8-ff6e583b695a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.133446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2bb007b-745b-49fa-baa8-ff6e583b695a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.133446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2bb007b-745b-49fa-baa8-ff6e583b695a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.133446] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2bb007b-745b-49fa-baa8-ff6e583b695a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.533212] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7badc13-9d4e-4301-bc04-ff5704ab29d9 [ 598.533212] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.533212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.533212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.533212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.533212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.533212] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7badc13-9d4e-4301-bc04-ff5704ab29d9 already deleted. [ 598.533508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7badc13-9d4e-4301-bc04-ff5704ab29d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.635142] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2bb007b-745b-49fa-baa8-ff6e583b695a [ 598.635256] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.635345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.635475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.637601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.637601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.637601] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2bb007b-745b-49fa-baa8-ff6e583b695a already deleted. [ 598.637601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2bb007b-745b-49fa-baa8-ff6e583b695a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.549778] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6285b91a-e562-47cc-b284-d0535a824973 None None] Enqueued Resource ID: 486ce44f-2c01-4dc0-88b8-6400d888a2f7 with Priority: HIGHEST for action port [ 599.550407] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 486ce44f-2c01-4dc0-88b8-6400d888a2f7 with Priority: HIGHEST for action port [ 599.550713] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-486ce44f-2c01-4dc0-88b8-6400d888a2f7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.550876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-486ce44f-2c01-4dc0-88b8-6400d888a2f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.550951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-486ce44f-2c01-4dc0-88b8-6400d888a2f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.551309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-486ce44f-2c01-4dc0-88b8-6400d888a2f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.551386] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('486ce44f-2c01-4dc0-88b8-6400d888a2f7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.587363] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6370569c-bbb5-46a1-8ecb-e8f72aea3920 None None] Enqueued Resource ID: db764228-0496-45dc-9594-737dfb6e547f with Priority: HIGHEST for action port [ 599.587788] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db764228-0496-45dc-9594-737dfb6e547f with Priority: HIGHEST for action port [ 599.588040] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-db764228-0496-45dc-9594-737dfb6e547f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.588148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db764228-0496-45dc-9594-737dfb6e547f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.588212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db764228-0496-45dc-9594-737dfb6e547f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.588452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db764228-0496-45dc-9594-737dfb6e547f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.588540] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db764228-0496-45dc-9594-737dfb6e547f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.053562] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 486ce44f-2c01-4dc0-88b8-6400d888a2f7 [ 600.053737] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.053876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.053943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.054171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.054261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.054363] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:486ce44f-2c01-4dc0-88b8-6400d888a2f7 already deleted. [ 600.054444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-486ce44f-2c01-4dc0-88b8-6400d888a2f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.091239] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db764228-0496-45dc-9594-737dfb6e547f [ 600.091474] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.091717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.091717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.091847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.091906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.092018] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db764228-0496-45dc-9594-737dfb6e547f already deleted. [ 600.092137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db764228-0496-45dc-9594-737dfb6e547f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.690309] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7b200f8f-b98c-4bca-900b-d12a9145b49e None None] Enqueued Resource ID: cd067580-80f0-4352-a1e3-e90105174c95 with Priority: HIGHEST for action port [ 600.693687] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd067580-80f0-4352-a1e3-e90105174c95 with Priority: HIGHEST for action port [ 600.693687] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd067580-80f0-4352-a1e3-e90105174c95 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.693687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd067580-80f0-4352-a1e3-e90105174c95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.693687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd067580-80f0-4352-a1e3-e90105174c95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.693687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd067580-80f0-4352-a1e3-e90105174c95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.693687] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd067580-80f0-4352-a1e3-e90105174c95',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.195921] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd067580-80f0-4352-a1e3-e90105174c95 [ 601.195921] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.195921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.195921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.195921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.195921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.195921] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd067580-80f0-4352-a1e3-e90105174c95 already deleted. [ 601.195921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd067580-80f0-4352-a1e3-e90105174c95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.190224] env[65630]: INFO networking_nsxv3.common.synchronization [None req-57bd75c4-3c66-4d69-bbc2-eb928420439e None None] Enqueued Resource ID: bd8b9286-3752-48ed-82d3-90a35e3fafe8 with Priority: HIGHEST for action port [ 602.190224] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8b9286-3752-48ed-82d3-90a35e3fafe8 with Priority: HIGHEST for action port [ 602.190224] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd8b9286-3752-48ed-82d3-90a35e3fafe8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.190224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd8b9286-3752-48ed-82d3-90a35e3fafe8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.190224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd8b9286-3752-48ed-82d3-90a35e3fafe8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.190224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd8b9286-3752-48ed-82d3-90a35e3fafe8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.190224] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd8b9286-3752-48ed-82d3-90a35e3fafe8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.693692] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd8b9286-3752-48ed-82d3-90a35e3fafe8 [ 602.693930] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.694140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.694140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.694524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.694524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.694524] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd8b9286-3752-48ed-82d3-90a35e3fafe8 already deleted. [ 602.694693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd8b9286-3752-48ed-82d3-90a35e3fafe8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.744727] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9d17567d-ec8e-4456-9dee-6075a2557c33 None None] Enqueued Resource ID: 809dc585-6d44-4ef5-b927-c9636403d5d6 with Priority: HIGHEST for action port [ 602.745038] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809dc585-6d44-4ef5-b927-c9636403d5d6 with Priority: HIGHEST for action port [ 602.745592] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-809dc585-6d44-4ef5-b927-c9636403d5d6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.745716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-809dc585-6d44-4ef5-b927-c9636403d5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.745781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-809dc585-6d44-4ef5-b927-c9636403d5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.746042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-809dc585-6d44-4ef5-b927-c9636403d5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.746126] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('809dc585-6d44-4ef5-b927-c9636403d5d6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.903401] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e25591f2-a6f0-4260-a780-d3fc88d7b4e2 None None] Enqueued Resource ID: b39e2fa8-ad5c-4618-8675-99ec7264879e with Priority: HIGHEST for action port [ 602.904241] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b39e2fa8-ad5c-4618-8675-99ec7264879e with Priority: HIGHEST for action port [ 602.905359] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b39e2fa8-ad5c-4618-8675-99ec7264879e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.905359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b39e2fa8-ad5c-4618-8675-99ec7264879e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.905359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b39e2fa8-ad5c-4618-8675-99ec7264879e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.905359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b39e2fa8-ad5c-4618-8675-99ec7264879e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.905580] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b39e2fa8-ad5c-4618-8675-99ec7264879e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.248575] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 809dc585-6d44-4ef5-b927-c9636403d5d6 [ 603.249175] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.249175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.249175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.249175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.249432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.249432] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:809dc585-6d44-4ef5-b927-c9636403d5d6 already deleted. [ 603.249432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-809dc585-6d44-4ef5-b927-c9636403d5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.409042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b39e2fa8-ad5c-4618-8675-99ec7264879e [ 603.409042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.409042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.409042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.409042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.409438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.409438] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b39e2fa8-ad5c-4618-8675-99ec7264879e already deleted. [ 603.409438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b39e2fa8-ad5c-4618-8675-99ec7264879e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.487126] env[65630]: INFO networking_nsxv3.common.synchronization [None req-4dc0dfe0-c8ed-420f-8723-d6ec4d9df23b None None] Enqueued Resource ID: 1e4f3918-8e7d-47ce-ae36-b523e91d357e with Priority: HIGHEST for action port [ 603.488233] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4f3918-8e7d-47ce-ae36-b523e91d357e with Priority: HIGHEST for action port [ 603.488233] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e4f3918-8e7d-47ce-ae36-b523e91d357e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.492029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e4f3918-8e7d-47ce-ae36-b523e91d357e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.492029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e4f3918-8e7d-47ce-ae36-b523e91d357e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.492029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e4f3918-8e7d-47ce-ae36-b523e91d357e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.492029] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e4f3918-8e7d-47ce-ae36-b523e91d357e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.888716] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6d82ff82-dd4c-48ca-b01f-03564e537330 None None] Enqueued Resource ID: 6653f12b-1082-4361-b2eb-bd81be84c30f with Priority: HIGHEST for action port [ 603.889477] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6653f12b-1082-4361-b2eb-bd81be84c30f with Priority: HIGHEST for action port [ 603.889477] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6653f12b-1082-4361-b2eb-bd81be84c30f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.889680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6653f12b-1082-4361-b2eb-bd81be84c30f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.889680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6653f12b-1082-4361-b2eb-bd81be84c30f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.889888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6653f12b-1082-4361-b2eb-bd81be84c30f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.890016] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6653f12b-1082-4361-b2eb-bd81be84c30f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.993777] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e4f3918-8e7d-47ce-ae36-b523e91d357e [ 603.996721] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.996721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.996721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.996721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.996721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.996721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e4f3918-8e7d-47ce-ae36-b523e91d357e already deleted. [ 603.996721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e4f3918-8e7d-47ce-ae36-b523e91d357e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.397259] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6653f12b-1082-4361-b2eb-bd81be84c30f [ 604.397259] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.397259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.397259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.397259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.397259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.397746] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6653f12b-1082-4361-b2eb-bd81be84c30f already deleted. [ 604.397746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6653f12b-1082-4361-b2eb-bd81be84c30f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.722704] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1614dd5b-8ee2-409d-902c-7e9a6af0ad01 None None] Enqueued Resource ID: 2f41a16d-6a13-402b-b9ce-3636c4cf52a8 with Priority: HIGHEST for action port [ 605.725659] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f41a16d-6a13-402b-b9ce-3636c4cf52a8 with Priority: HIGHEST for action port [ 605.725659] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f41a16d-6a13-402b-b9ce-3636c4cf52a8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.727335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f41a16d-6a13-402b-b9ce-3636c4cf52a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.727335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f41a16d-6a13-402b-b9ce-3636c4cf52a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.727335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f41a16d-6a13-402b-b9ce-3636c4cf52a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.727335] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f41a16d-6a13-402b-b9ce-3636c4cf52a8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.232188] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f41a16d-6a13-402b-b9ce-3636c4cf52a8 [ 606.232567] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.235599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.235599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.235599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.235599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.235599] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f41a16d-6a13-402b-b9ce-3636c4cf52a8 already deleted. [ 606.235599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f41a16d-6a13-402b-b9ce-3636c4cf52a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.343713] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a9e5850e-6dd6-4a6d-ac15-91034cf5e63f None None] Enqueued Resource ID: 91ff7ce7-f435-40d7-8691-5785652f1499 with Priority: HIGHEST for action port [ 606.344113] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ff7ce7-f435-40d7-8691-5785652f1499 with Priority: HIGHEST for action port [ 606.344433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ff7ce7-f435-40d7-8691-5785652f1499 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.344555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ff7ce7-f435-40d7-8691-5785652f1499" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.345272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ff7ce7-f435-40d7-8691-5785652f1499" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.345272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ff7ce7-f435-40d7-8691-5785652f1499" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.345272] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ff7ce7-f435-40d7-8691-5785652f1499',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.779207] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2aa37b4-3408-43b8-a940-e50b03fd3e93 req-776856b1-47cc-4426-aa57-4c5155450ea1 tempest-FloatingIPsAssociationTestJSON-476441825 tempest-FloatingIPsAssociationTestJSON-476441825-project-member] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 606.779207] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 606.779207] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.779207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.779207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.779207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.781132] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.781676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.781676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.781676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.781845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.782114] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.851024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91ff7ce7-f435-40d7-8691-5785652f1499 [ 606.851024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.851024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.851024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.851263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.851263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.851324] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91ff7ce7-f435-40d7-8691-5785652f1499 already deleted. [ 606.851835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ff7ce7-f435-40d7-8691-5785652f1499" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.153264] env[65630]: INFO networking_nsxv3.common.synchronization [None req-fa7b2405-f6d1-4a17-965a-a31e59eadb38 tempest-ServersV294TestFqdnHostnames-1296887170 tempest-ServersV294TestFqdnHostnames-1296887170-project-member] Enqueued Resource ID: fd38ba44-4bae-4133-9932-405c81cc5c6a with Priority: HIGHEST for action security_group_rules [ 607.153844] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd38ba44-4bae-4133-9932-405c81cc5c6a with Priority: HIGHEST for action security_group_rules [ 607.154268] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd38ba44-4bae-4133-9932-405c81cc5c6a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.154931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.154931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.154931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.154931] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd38ba44-4bae-4133-9932-405c81cc5c6a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.286306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.286613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.286613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.286793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.286940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.287190] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.287927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.287927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.287927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.287927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.287927] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 already deleted. [ 607.287927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.434706] env[65630]: INFO networking_nsxv3.common.synchronization [None req-ddd33a10-fb60-4a49-9629-68877be88db9 tempest-ServersV294TestFqdnHostnames-1296887170 tempest-ServersV294TestFqdnHostnames-1296887170-project-member] Enqueued Resource ID: fd38ba44-4bae-4133-9932-405c81cc5c6a with Priority: HIGHEST for action security_group_rules [ 607.434706] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd38ba44-4bae-4133-9932-405c81cc5c6a with Priority: HIGHEST for action security_group_rules [ 607.434881] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd38ba44-4bae-4133-9932-405c81cc5c6a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.434881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.683980] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.684193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.684193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.684451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.684544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.684665] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd38ba44-4bae-4133-9932-405c81cc5c6a already deleted. [ 607.684753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.684906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.685071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.685155] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd38ba44-4bae-4133-9932-405c81cc5c6a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.857647] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.858049] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.858049] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.858536] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.858846] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.859016] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.859138] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.859406] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.859555] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.859847] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.859963] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.860086] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.860195] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.860354] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.860490] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.860561] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.887311] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.887488] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.887641] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.887827] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.888163] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-d0341c66-c50c-4d6c-a6b4-0b9243227254 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.888335] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.888476] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.888862] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.889010] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0341c66-c50c-4d6c-a6b4-0b9243227254',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.211016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.211885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.211885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.211885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.211885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.212183] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd38ba44-4bae-4133-9932-405c81cc5c6a already deleted. [ 608.212183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd38ba44-4bae-4133-9932-405c81cc5c6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.302270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.302735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.302735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.302876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.303139] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.392965] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.393266] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.393424] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.393755] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.394673] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.394855] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port d0341c66-c50c-4d6c-a6b4-0b9243227254 not found, creating... [ 608.395168] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.395330] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.395452] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.395690] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.395821] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.396242] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.396407] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.396523] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.396737] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.396869] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.397018] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: d0341c66-c50c-4d6c-a6b4-0b9243227254 is going to be created. [ 608.422691] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.422910] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.423041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.423525] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.423631] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.423754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.646888] env[65630]: INFO networking_nsxv3.common.synchronization [req-cbdc0566-4540-455e-a739-f9f7ef542ffe req-782e9760-ab31-4340-88a7-754303c79ab9 tempest-SecurityGroupRulesNegativeTestJSON-750270040 tempest-SecurityGroupRulesNegativeTestJSON-750270040-project-member] Enqueued Resource ID: 61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 with Priority: HIGHEST for action security_group_rules [ 608.647309] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 with Priority: HIGHEST for action security_group_rules [ 608.651105] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.651199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.651327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.651737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.651876] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61ca90ab-fbe4-4e9e-bde6-e633fdd233e9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.661343] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b30616c3-bfb1-447c-b841-4af15c91d8d5 None None] Enqueued Resource ID: 8649201c-174c-4318-b1f6-71171fc4852f with Priority: HIGHEST for action port [ 608.661533] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8649201c-174c-4318-b1f6-71171fc4852f with Priority: HIGHEST for action port [ 608.661776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-8649201c-174c-4318-b1f6-71171fc4852f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.661898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8649201c-174c-4318-b1f6-71171fc4852f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.661956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8649201c-174c-4318-b1f6-71171fc4852f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.662500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8649201c-174c-4318-b1f6-71171fc4852f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.662500] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8649201c-174c-4318-b1f6-71171fc4852f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.808493] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.165472] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8649201c-174c-4318-b1f6-71171fc4852f [ 609.166471] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.166471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.166471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.166471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.166471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.166471] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8649201c-174c-4318-b1f6-71171fc4852f already deleted. [ 609.167357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8649201c-174c-4318-b1f6-71171fc4852f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.184148] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.184148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.184148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.184148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.184148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.184148] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 already deleted. [ 609.184148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.283296] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2aa37b4-3408-43b8-a940-e50b03fd3e93 req-90b3cf69-0d4d-496c-b880-a14b0b4f88fa service nova] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_rules [ 609.283486] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2aa37b4-3408-43b8-a940-e50b03fd3e93 req-90b3cf69-0d4d-496c-b880-a14b0b4f88fa service nova] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 609.283669] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2aa37b4-3408-43b8-a940-e50b03fd3e93 req-90b3cf69-0d4d-496c-b880-a14b0b4f88fa service nova] Enqueued Resource ID: d0341c66-c50c-4d6c-a6b4-0b9243227254 with Priority: HIGHEST for action port [ 609.284547] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_rules [ 609.284734] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 609.284924] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0341c66-c50c-4d6c-a6b4-0b9243227254 with Priority: HIGHEST for action port [ 609.285368] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.285558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.285645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.285934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.286097] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.288685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.288685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.288685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.288685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.288685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.288685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.288685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.288685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.288685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.288685] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.289908] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0341c66-c50c-4d6c-a6b4-0b9243227254 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.290383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.290581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.290660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.290715] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0341c66-c50c-4d6c-a6b4-0b9243227254',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.309898] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.792763] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.793382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.803081] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.804080] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0341c66-c50c-4d6c-a6b4-0b9243227254 with status ACTIVE [ 609.804688] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.804844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.804911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.805925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.805925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.805925] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.805925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.805925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.805925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.806248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.806248] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.806333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.806367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.806512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.806593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.806664] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0341c66-c50c-4d6c-a6b4-0b9243227254 is going to be updated. [ 609.812509] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 609.812552] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 609.847394] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.847574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.847626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.848132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.848132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.848311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0341c66-c50c-4d6c-a6b4-0b9243227254" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.309518] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.799527] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.799527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.799527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.799527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.810527] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 610.812674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.812769] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 610.814432] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.814605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.814679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.814888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.815154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.815281] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 is going to be created. [ 610.821130] env[65630]: INFO networking_nsxv3.common.synchronization [req-9675f44c-1e9c-400a-8203-4237965d8826 req-a248a56d-088e-4e28-b828-7116d0abbb12 tempest-ServersAdminNegativeTestJSON-2028070641 tempest-ServersAdminNegativeTestJSON-2028070641-project-member] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 610.822498] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 610.822859] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.823325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.823485] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.823793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.823876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.823965] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.840886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.840886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.840886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.841151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.841542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.842934] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 610.842934] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 610.842934] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 610.856325] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.856325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.856325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.856325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.856507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.875578] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: UNINITIALIZED for 2s [ 610.877209] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.877336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.877428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.877644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.877778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.878454] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 610.901522] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.901687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.901739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.902046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.902111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.902198] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 610.926567] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.927121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.927121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.927121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.927261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.927329] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 610.927413] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 610.927487] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 610.947411] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.947587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.947671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.947882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.947965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.948090] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 610.948165] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 610.948238] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 610.984635] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.986427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.986427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.986427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.986427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.986427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 610.986427] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 610.986427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 610.986427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 610.986427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 610.986427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 610.986427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 610.986940] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.986940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.986940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.986940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.987157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.987390] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 610.987925] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 610.987925] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 611.019665] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.019851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.019997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.020190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.020313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.020566] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 611.049257] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.049257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.049257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.049257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.049257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.061369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.301175] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6d716be3-1990-4af9-bf52-c48e4bc977f9 None None] Enqueued Resource ID: 5135d34c-50f1-4b9c-98cd-b6aaead8837e with Priority: HIGHEST for action port [ 611.304167] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5135d34c-50f1-4b9c-98cd-b6aaead8837e with Priority: HIGHEST for action port [ 611.304913] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5135d34c-50f1-4b9c-98cd-b6aaead8837e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.305097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5135d34c-50f1-4b9c-98cd-b6aaead8837e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.305197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5135d34c-50f1-4b9c-98cd-b6aaead8837e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.305491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5135d34c-50f1-4b9c-98cd-b6aaead8837e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.305577] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5135d34c-50f1-4b9c-98cd-b6aaead8837e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.328525] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.329640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.329640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.329640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.329640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.329640] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.329640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.329640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.329640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.330106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.330106] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b already deleted. [ 611.330106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.661526] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.661694] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.661808] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.662141] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.662715] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.663516] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.663516] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.663516] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.663748] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.664036] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.664036] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.664036] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.664196] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.664244] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.664487] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.664487] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.685706] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.685900] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.685999] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.686179] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.686482] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-d2361973-77eb-44c5-89e2-12e822f477a1 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.686728] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.686853] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.687188] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.687327] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2361973-77eb-44c5-89e2-12e822f477a1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.807942] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5135d34c-50f1-4b9c-98cd-b6aaead8837e [ 611.810234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.810234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.810234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.810234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.810234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.810234] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5135d34c-50f1-4b9c-98cd-b6aaead8837e already deleted. [ 611.810234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5135d34c-50f1-4b9c-98cd-b6aaead8837e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.189765] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.190027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.190223] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.190564] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.190733] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.191038] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port d2361973-77eb-44c5-89e2-12e822f477a1 not found, creating... [ 612.191164] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.191329] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.191419] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.191638] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.191808] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.192053] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.192217] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.192296] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.192531] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.192625] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.192762] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: d2361973-77eb-44c5-89e2-12e822f477a1 is going to be created. [ 612.219619] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.219865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.219865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.220162] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.220385] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.220766] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.419314] env[65630]: INFO networking_nsxv3.common.synchronization [None req-49673bdb-a6b9-4eb0-a9fe-aa10fe0a045e None None] Enqueued Resource ID: 2926d590-d155-455b-a4bb-55d814604d34 with Priority: HIGHEST for action port [ 612.420576] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2926d590-d155-455b-a4bb-55d814604d34 with Priority: HIGHEST for action port [ 612.420576] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2926d590-d155-455b-a4bb-55d814604d34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.420576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2926d590-d155-455b-a4bb-55d814604d34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.420874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2926d590-d155-455b-a4bb-55d814604d34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.420874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2926d590-d155-455b-a4bb-55d814604d34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.420957] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2926d590-d155-455b-a4bb-55d814604d34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.886663] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: SUCCESS [ 612.886874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.887064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.887296] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.887647] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.887647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.887647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.888736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.888736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.888736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.888736] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.924498] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2926d590-d155-455b-a4bb-55d814604d34 [ 612.924709] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.924852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.924919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.925168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.925264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.925433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2926d590-d155-455b-a4bb-55d814604d34 already deleted. [ 612.925433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2926d590-d155-455b-a4bb-55d814604d34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.928660] env[65630]: INFO networking_nsxv3.common.synchronization [req-9675f44c-1e9c-400a-8203-4237965d8826 req-ee822edd-c476-4136-bb81-41379fe5d6ca service nova] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_rules [ 612.928855] env[65630]: INFO networking_nsxv3.common.synchronization [req-9675f44c-1e9c-400a-8203-4237965d8826 req-ee822edd-c476-4136-bb81-41379fe5d6ca service nova] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 612.928994] env[65630]: INFO networking_nsxv3.common.synchronization [req-9675f44c-1e9c-400a-8203-4237965d8826 req-ee822edd-c476-4136-bb81-41379fe5d6ca service nova] Enqueued Resource ID: d2361973-77eb-44c5-89e2-12e822f477a1 with Priority: HIGHEST for action port [ 612.929232] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_rules [ 612.929358] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 612.929663] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2361973-77eb-44c5-89e2-12e822f477a1 with Priority: HIGHEST for action port [ 612.930139] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.930265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.930363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.930594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.930680] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.931506] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.931617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.931682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.931875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.932032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.932121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.932181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.932436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.932436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.932527] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.933240] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2361973-77eb-44c5-89e2-12e822f477a1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.933344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.933404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.934044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.934044] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2361973-77eb-44c5-89e2-12e822f477a1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.391221] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.391398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.391452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.392385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.392584] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.393395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.393395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.393395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.393395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.393395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.393395] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.393395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.393395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.393700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.393731] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.393803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.394021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.394021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.394104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.394150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.394234] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.435327] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.435637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.435637] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.436622] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2361973-77eb-44c5-89e2-12e822f477a1 with status ACTIVE [ 613.436805] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.436949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.437036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.437248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.437341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.437525] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.437616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.437677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.437835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.437916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.441307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.441307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.441307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.441424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.441497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.441581] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2361973-77eb-44c5-89e2-12e822f477a1 is going to be updated. [ 613.471033] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.471033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.471420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.471458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.471656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.472181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2361973-77eb-44c5-89e2-12e822f477a1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.494124] env[65630]: INFO networking_nsxv3.common.synchronization [None req-c5b1dc4d-3e21-4c8a-9161-2316c140d210 None None] Enqueued Resource ID: 75ed9582-f103-4ad3-ba38-8411f2d9e5d6 with Priority: HIGHEST for action port [ 613.494972] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ed9582-f103-4ad3-ba38-8411f2d9e5d6 with Priority: HIGHEST for action port [ 613.495340] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-75ed9582-f103-4ad3-ba38-8411f2d9e5d6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.495495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75ed9582-f103-4ad3-ba38-8411f2d9e5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.495563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75ed9582-f103-4ad3-ba38-8411f2d9e5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.496234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75ed9582-f103-4ad3-ba38-8411f2d9e5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.496234] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75ed9582-f103-4ad3-ba38-8411f2d9e5d6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.503862] env[65630]: INFO networking_nsxv3.common.synchronization [req-e6319bcb-5698-461a-8576-12b0dab1494b req-e6044163-d1de-47ad-a8e6-8b74878b7145 tempest-InstanceActionsTestJSON-690180015 tempest-InstanceActionsTestJSON-690180015-project-member] Enqueued Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_members [ 613.504422] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_members [ 613.504759] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.504913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.504913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.505653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.505923] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.506061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.506124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.506319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.506489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.506548] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.897147] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f9d43bc-6007-4e6a-81c6-321db263b170: rpc.has_security_group_logging(os_id): False [ 613.920894] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.920894] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.920894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.921333] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.921333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.921333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.921679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.921679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.921679] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.921795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.921795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.922097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.922097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.922220] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 is going to be created. [ 613.945077] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.987232] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.987232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.987232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.987232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.987232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.000085] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75ed9582-f103-4ad3-ba38-8411f2d9e5d6 [ 614.000085] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.000085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.000264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.000365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.000653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.000653] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75ed9582-f103-4ad3-ba38-8411f2d9e5d6 already deleted. [ 614.000653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75ed9582-f103-4ad3-ba38-8411f2d9e5d6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.001575] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: IN_PROGRESS for 2s [ 614.010155] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.010330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.010468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.010693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.010752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.010904] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.011105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.011105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.011224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.011537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.011537] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f already deleted. [ 614.012123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.217078] env[65630]: INFO networking_nsxv3.common.synchronization [None req-813f3ef2-77ae-4f18-9a31-d64d22f97c25 None None] Enqueued Resource ID: a38f8c7f-b7f1-4385-a0a4-8259467e6b25 with Priority: HIGHEST for action port [ 614.217618] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38f8c7f-b7f1-4385-a0a4-8259467e6b25 with Priority: HIGHEST for action port [ 614.217976] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a38f8c7f-b7f1-4385-a0a4-8259467e6b25 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.218139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a38f8c7f-b7f1-4385-a0a4-8259467e6b25" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.218139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a38f8c7f-b7f1-4385-a0a4-8259467e6b25" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.218447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a38f8c7f-b7f1-4385-a0a4-8259467e6b25" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.218520] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a38f8c7f-b7f1-4385-a0a4-8259467e6b25',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.320583] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-864 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.320760] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-864" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.321111] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-864" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.321223] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-864" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.321493] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.322109] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.322109] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.322109] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.322109] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.322311] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.322436] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.322548] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.322659] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.322770] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.322953] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.323027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.346541] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.346721] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.346836] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.347012] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-864" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.347349] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-d26562d0-643a-49ae-a919-f0c4ce70781f taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.347513] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.347633] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.347960] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.348901] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26562d0-643a-49ae-a919-f0c4ce70781f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.447276] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.447614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.447696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.448036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.448180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.448352] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be created. [ 614.474986] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.475174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.475267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.475512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.475708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.491568] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: UNINITIALIZED for 2s [ 614.721416] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a38f8c7f-b7f1-4385-a0a4-8259467e6b25 [ 614.721666] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.721809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.721877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.722118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.722210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.722304] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a38f8c7f-b7f1-4385-a0a4-8259467e6b25 already deleted. [ 614.722386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a38f8c7f-b7f1-4385-a0a4-8259467e6b25" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.850305] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.850612] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.850740] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.851156] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.851349] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.851544] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port d26562d0-643a-49ae-a919-f0c4ce70781f not found, creating... [ 614.851830] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.852045] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.852196] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.852525] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.852690] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.853036] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.853244] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.853371] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.853587] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.853712] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.853848] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: d26562d0-643a-49ae-a919-f0c4ce70781f is going to be created. [ 614.876825] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.877045] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.877158] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.877448] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.877671] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.877897] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.580576] env[65630]: INFO networking_nsxv3.common.synchronization [req-e6319bcb-5698-461a-8576-12b0dab1494b req-b4c84207-1962-4b15-b451-d95ae7a5577f service nova] Enqueued Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_rules [ 615.580857] env[65630]: INFO networking_nsxv3.common.synchronization [req-e6319bcb-5698-461a-8576-12b0dab1494b req-b4c84207-1962-4b15-b451-d95ae7a5577f service nova] Enqueued Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_members [ 615.580959] env[65630]: INFO networking_nsxv3.common.synchronization [req-e6319bcb-5698-461a-8576-12b0dab1494b req-b4c84207-1962-4b15-b451-d95ae7a5577f service nova] Enqueued Resource ID: d26562d0-643a-49ae-a919-f0c4ce70781f with Priority: HIGHEST for action port [ 615.582454] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_rules [ 615.582454] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_members [ 615.582454] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26562d0-643a-49ae-a919-f0c4ce70781f with Priority: HIGHEST for action port [ 615.582454] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.582454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.582454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.582740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.582877] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.583864] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.585871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.585871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.586458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.586458] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.586458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.586458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.592557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.592557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.592557] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.592557] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d26562d0-643a-49ae-a919-f0c4ce70781f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.592557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.592557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.592557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.592557] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26562d0-643a-49ae-a919-f0c4ce70781f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.623570] env[65630]: INFO networking_nsxv3.common.synchronization [None req-d715ee69-0ef4-4536-b398-7dfcf7404726 None None] Enqueued Resource ID: d8cefc5e-6971-4240-9878-19fb23169833 with Priority: HIGHEST for action port [ 615.624102] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8cefc5e-6971-4240-9878-19fb23169833 with Priority: HIGHEST for action port [ 615.624719] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8cefc5e-6971-4240-9878-19fb23169833 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.624719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8cefc5e-6971-4240-9878-19fb23169833" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.624872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8cefc5e-6971-4240-9878-19fb23169833" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.625228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8cefc5e-6971-4240-9878-19fb23169833" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.625324] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8cefc5e-6971-4240-9878-19fb23169833',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.675968] env[65630]: INFO networking_nsxv3.common.synchronization [req-f97e4a22-f6e6-441c-af0b-ff50e987ee39 req-4b20fbd1-3070-4c04-8ff1-3767a72425cc tempest-FloatingIPsAssociationNegativeTestJSON-1445942793 tempest-FloatingIPsAssociationNegativeTestJSON-1445942793-project-member] Enqueued Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_members [ 615.676440] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_members [ 615.676776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.676906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.676978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.677278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.677435] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.677538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.677600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.677753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.677993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.677993] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.016149] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: SUCCESS [ 616.016149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.093530] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.094963] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.094963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.101023] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d26562d0-643a-49ae-a919-f0c4ce70781f with status ACTIVE [ 616.101023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.101023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.101023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.101023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.101023] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d26562d0-643a-49ae-a919-f0c4ce70781f is going to be updated. [ 616.125743] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.125912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.125991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.126707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.126876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.126996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d26562d0-643a-49ae-a919-f0c4ce70781f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.131196] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8cefc5e-6971-4240-9878-19fb23169833 [ 616.131395] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.131524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.131589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.131812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.132024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.132024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8cefc5e-6971-4240-9878-19fb23169833 already deleted. [ 616.132146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8cefc5e-6971-4240-9878-19fb23169833" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.182028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.182028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.182028] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff already deleted. [ 616.182028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.505787] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: SUCCESS [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.505787] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.505787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.505787] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.518048] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.519192] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-519" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.519475] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-519" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.519905] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-519" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.525041] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.525041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.525041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.525041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.525041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.525041] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.525041] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.525041] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.525041] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.525041] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.525041] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.525041] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.546155] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.546327] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.546457] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.546632] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-519" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.546942] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-e1a04467-78a5-4be7-bc50-26df05d2206b taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.547114] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.547220] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.548686] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.548686] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a04467-78a5-4be7-bc50-26df05d2206b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.597221] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.847330] env[65630]: INFO networking_nsxv3.common.synchronization [None req-569ea813-aef8-4e6c-8f8c-7830bd92a1f3 None None] Enqueued Resource ID: c56e41a1-cb43-449b-a900-3a6cbf3f64ba with Priority: HIGHEST for action port [ 616.847611] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c56e41a1-cb43-449b-a900-3a6cbf3f64ba with Priority: HIGHEST for action port [ 616.848219] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c56e41a1-cb43-449b-a900-3a6cbf3f64ba taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.848342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c56e41a1-cb43-449b-a900-3a6cbf3f64ba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.848406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c56e41a1-cb43-449b-a900-3a6cbf3f64ba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.848650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c56e41a1-cb43-449b-a900-3a6cbf3f64ba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.848727] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c56e41a1-cb43-449b-a900-3a6cbf3f64ba',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.008997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.009154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.009154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.009332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.009572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.009701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.009765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.010236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.010384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.010546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.010754] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.010866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.010946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.011340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.011340] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.011340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.011620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.011620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.011620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.011712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.011780] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.052115] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.052710] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.052710] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.052891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.053144] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.053292] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port e1a04467-78a5-4be7-bc50-26df05d2206b not found, creating... [ 617.053561] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.053720] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.053835] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.054077] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.054214] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.054496] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.054645] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.054755] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.054993] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.055839] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.055839] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: e1a04467-78a5-4be7-bc50-26df05d2206b is going to be created. [ 617.083845] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.083845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.083845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.083845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.084248] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.084298] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.099732] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.099879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.100338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.100338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.100338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.100338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f is going to be created. [ 617.125866] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.126018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.126088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.126307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.126469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.137061] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f in Status: UNINITIALIZED for 2s [ 617.355938] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c56e41a1-cb43-449b-a900-3a6cbf3f64ba [ 617.357023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.357396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.357396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.357558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.357623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.357876] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c56e41a1-cb43-449b-a900-3a6cbf3f64ba already deleted. [ 617.357876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c56e41a1-cb43-449b-a900-3a6cbf3f64ba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.435563] env[65630]: INFO networking_nsxv3.common.synchronization [None req-f5ef35c2-fa44-456e-9814-aa456bb4606e None None] Enqueued Resource ID: 4486914d-8b12-4e01-98ee-e28745c8c97b with Priority: HIGHEST for action port [ 617.436179] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4486914d-8b12-4e01-98ee-e28745c8c97b with Priority: HIGHEST for action port [ 617.436482] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4486914d-8b12-4e01-98ee-e28745c8c97b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.436600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4486914d-8b12-4e01-98ee-e28745c8c97b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.436668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4486914d-8b12-4e01-98ee-e28745c8c97b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.436913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4486914d-8b12-4e01-98ee-e28745c8c97b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.436992] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4486914d-8b12-4e01-98ee-e28745c8c97b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.515317] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fceb03c-a6a6-44ca-a458-09915f16c26b: rpc.has_security_group_logging(os_id): False [ 617.539195] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.539195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.539195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.539195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.539195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.539195] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.539195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.539195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.539195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.539670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.539670] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.539670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.539670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.539797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.539797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.539970] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.540185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.540304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.540475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.540562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.541458] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be created. [ 617.605956] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.605956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.605956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.605956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.605956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.617288] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: IN_PROGRESS for 2s [ 617.845977] env[65630]: INFO networking_nsxv3.common.synchronization [req-f97e4a22-f6e6-441c-af0b-ff50e987ee39 req-287c5501-0ccf-420c-887b-7720a8b7c1a8 service nova] Enqueued Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_rules [ 617.846678] env[65630]: INFO networking_nsxv3.common.synchronization [req-f97e4a22-f6e6-441c-af0b-ff50e987ee39 req-287c5501-0ccf-420c-887b-7720a8b7c1a8 service nova] Enqueued Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_members [ 617.847315] env[65630]: INFO networking_nsxv3.common.synchronization [req-f97e4a22-f6e6-441c-af0b-ff50e987ee39 req-287c5501-0ccf-420c-887b-7720a8b7c1a8 service nova] Enqueued Resource ID: e1a04467-78a5-4be7-bc50-26df05d2206b with Priority: HIGHEST for action port [ 617.847985] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_rules [ 617.848307] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_members [ 617.848307] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a04467-78a5-4be7-bc50-26df05d2206b with Priority: HIGHEST for action port [ 617.848598] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.848758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.848797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.849267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.849267] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.850830] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.850894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.850932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.851138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.851289] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.851385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.851464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.851618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.851660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.851748] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.853093] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a04467-78a5-4be7-bc50-26df05d2206b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.853217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.853337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.853381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.853453] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a04467-78a5-4be7-bc50-26df05d2206b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.939223] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4486914d-8b12-4e01-98ee-e28745c8c97b [ 617.939459] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.939616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.939687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.939900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.939985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.940091] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4486914d-8b12-4e01-98ee-e28745c8c97b already deleted. [ 617.940176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4486914d-8b12-4e01-98ee-e28745c8c97b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.261152] env[65630]: INFO networking_nsxv3.common.synchronization [None req-54bbed39-b092-4511-98b6-c5e0cb4be37a tempest-VolumesAssistedSnapshotsTest-482920267 tempest-VolumesAssistedSnapshotsTest-482920267-project-member] Enqueued Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_rules [ 618.261152] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_rules [ 618.261152] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.261152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.261664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.265711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.266497] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.355775] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.356899] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.357244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.357244] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1a04467-78a5-4be7-bc50-26df05d2206b with status ACTIVE [ 618.357412] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.357594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.358648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.358648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.358648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.358648] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.358865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.358865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.358930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.358966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.359598] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.359598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.359598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.359598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.359820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.359966] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1a04467-78a5-4be7-bc50-26df05d2206b is going to be updated. [ 618.384119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.384460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.384784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.384784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.385359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.385359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a04467-78a5-4be7-bc50-26df05d2206b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.609762] env[65630]: INFO networking_nsxv3.common.synchronization [None req-15223d94-c191-4df9-ba0e-37d452a341b1 None None] Enqueued Resource ID: 49296bbb-1132-4362-8fbe-c16153a54568 with Priority: HIGHEST for action port [ 618.610340] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49296bbb-1132-4362-8fbe-c16153a54568 with Priority: HIGHEST for action port [ 618.610702] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-49296bbb-1132-4362-8fbe-c16153a54568 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.610848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49296bbb-1132-4362-8fbe-c16153a54568" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.610902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49296bbb-1132-4362-8fbe-c16153a54568" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.611957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49296bbb-1132-4362-8fbe-c16153a54568" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.612084] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49296bbb-1132-4362-8fbe-c16153a54568',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.647919] env[65630]: INFO networking_nsxv3.common.synchronization [None req-27ec61bb-459a-4388-a11a-51bd56ac7eb9 tempest-VolumesAssistedSnapshotsTest-482920267 tempest-VolumesAssistedSnapshotsTest-482920267-project-member] Enqueued Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_rules [ 618.649799] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_rules [ 618.651273] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.651273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.788215] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.788382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.788423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.788642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.788738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.788833] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 already deleted. [ 618.788914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.789093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.789254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.789334] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.844811] env[65630]: INFO networking_nsxv3.common.synchronization [None req-2516edfd-d8c6-495d-acc9-6ccce4e0ada6 None None] Enqueued Resource ID: 58e03259-cb2c-4e2d-b4f1-adfc20a6ff99 with Priority: HIGHEST for action port [ 618.845330] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58e03259-cb2c-4e2d-b4f1-adfc20a6ff99 with Priority: HIGHEST for action port [ 618.845812] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-58e03259-cb2c-4e2d-b4f1-adfc20a6ff99 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.845812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58e03259-cb2c-4e2d-b4f1-adfc20a6ff99" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.845812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58e03259-cb2c-4e2d-b4f1-adfc20a6ff99" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.846351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58e03259-cb2c-4e2d-b4f1-adfc20a6ff99" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.846433] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58e03259-cb2c-4e2d-b4f1-adfc20a6ff99',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.862245] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.116373] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49296bbb-1132-4362-8fbe-c16153a54568 [ 619.116373] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.116373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.116373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.116373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.116373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.116373] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49296bbb-1132-4362-8fbe-c16153a54568 already deleted. [ 619.116373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49296bbb-1132-4362-8fbe-c16153a54568" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.150993] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f in Status: SUCCESS [ 619.151485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.151727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.151997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.153307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.153307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.153307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.153307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.153307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.153307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.153307] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.312229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.312453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.312453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.313795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.313795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.313795] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 already deleted. [ 619.313795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.351016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58e03259-cb2c-4e2d-b4f1-adfc20a6ff99 [ 619.351016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.351016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.351016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.351016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.351016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.351016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58e03259-cb2c-4e2d-b4f1-adfc20a6ff99 already deleted. [ 619.351016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58e03259-cb2c-4e2d-b4f1-adfc20a6ff99" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.365637] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.365840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.365904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.366320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.366458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.366565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff is going to be created. [ 619.404851] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.405058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.405141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.405401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.405571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.425280] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff in Status: UNINITIALIZED for 2s [ 619.631987] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: SUCCESS [ 619.632327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.656100] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.657468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.657468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.657761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.657839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.657954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.658090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.658196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.658301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.658396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.659032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.659032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.659032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.659262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.659295] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.659434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.659557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.659780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.659917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.661326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.661967] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.167156] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a30c8a0-56ed-49c0-9575-ac779408f52f: rpc.has_security_group_logging(os_id): False [ 620.188494] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.188494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.188494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.188494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.188494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.188852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.188852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.188852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.188967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.188998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.189210] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.189300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.189344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.189542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.189737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.189879] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.190000] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.190055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.190187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.190338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.190338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f is going to be created. [ 620.252225] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.252372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.252461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.252664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.252840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.265104] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f in Status: IN_PROGRESS for 2s [ 620.555655] env[65630]: INFO networking_nsxv3.common.synchronization [None req-bdb8c02a-ad07-419a-b363-d42fb76280ae None None] Enqueued Resource ID: ca776a9d-6cc4-455a-b42f-51d36b841058 with Priority: HIGHEST for action port [ 620.555655] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca776a9d-6cc4-455a-b42f-51d36b841058 with Priority: HIGHEST for action port [ 620.555943] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca776a9d-6cc4-455a-b42f-51d36b841058 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.556433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca776a9d-6cc4-455a-b42f-51d36b841058" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.556643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca776a9d-6cc4-455a-b42f-51d36b841058" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.557119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca776a9d-6cc4-455a-b42f-51d36b841058" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.557239] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca776a9d-6cc4-455a-b42f-51d36b841058',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.955041] env[65630]: INFO networking_nsxv3.common.synchronization [None req-549141a0-64ae-45f4-8dbb-dba6c006a5c7 None None] Enqueued Resource ID: 9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4 with Priority: HIGHEST for action port [ 620.955041] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4 with Priority: HIGHEST for action port [ 620.955041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.955041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.955614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.955992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.956211] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.060775] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca776a9d-6cc4-455a-b42f-51d36b841058 [ 621.060775] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.060775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.060775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.061431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.061431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.061431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca776a9d-6cc4-455a-b42f-51d36b841058 already deleted. [ 621.061573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca776a9d-6cc4-455a-b42f-51d36b841058" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.438180] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff in Status: SUCCESS [ 621.438180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.438180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.438180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.438180] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.438180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.438180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.438762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.438762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.438762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.438762] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.461130] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4 [ 621.461252] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.461420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.461504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.461986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.461986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.461986] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4 already deleted. [ 621.461986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c9515ce-b9ea-4bf2-aab0-4b55c3b175f4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.762188] env[65630]: INFO networking_nsxv3.common.synchronization [req-972f812e-677c-4c51-96e7-de69726a3033 req-418d8dfb-ea62-4dc9-8677-357f9026ca9c tempest-SecurityGroupRulesNegativeTestJSON-750270040 tempest-SecurityGroupRulesNegativeTestJSON-750270040-project-member] Enqueued Resource ID: 61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 with Priority: HIGHEST for action security_group_rules [ 621.762188] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 with Priority: HIGHEST for action security_group_rules [ 621.763394] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.763394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.763394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.763394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.763394] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61ca90ab-fbe4-4e9e-bde6-e633fdd233e9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.950042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.950042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.950042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.950042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.950042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.951164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.951164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.951164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.951164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.951164] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.281487] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f in Status: SUCCESS [ 622.281738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.286998] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.286998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.286998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.286998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.286998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.286998] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61ca90ab-fbe4-4e9e-bde6-e633fdd233e9 already deleted. [ 622.286998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61ca90ab-fbe4-4e9e-bde6-e633fdd233e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.454247] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b518e97-7b02-47cd-a0e2-8f4af219c7ff: rpc.has_security_group_logging(os_id): False [ 622.472904] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.473024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.473267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.474597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.474597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.474597] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.474597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.474597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.474597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.474597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.474597] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.474922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.474954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.475187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.475297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.475579] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.475747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.475831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.476258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.476258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.476258] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff is going to be created. [ 622.564466] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.564680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.564757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.565062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.565462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.581201] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff in Status: IN_PROGRESS for 2s [ 623.343031] env[65630]: INFO networking_nsxv3.common.synchronization [None req-cb73deea-2f0b-4a1d-acb8-c0288adca40b None None] Enqueued Resource ID: 48d4550e-7022-4b19-b989-d2222eefafbc with Priority: HIGHEST for action port [ 623.345727] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d4550e-7022-4b19-b989-d2222eefafbc with Priority: HIGHEST for action port [ 623.345727] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-48d4550e-7022-4b19-b989-d2222eefafbc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.345727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48d4550e-7022-4b19-b989-d2222eefafbc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.345727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48d4550e-7022-4b19-b989-d2222eefafbc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.346989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48d4550e-7022-4b19-b989-d2222eefafbc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.347101] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48d4550e-7022-4b19-b989-d2222eefafbc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.764713] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7d9348eb-5133-4703-88da-ae366b5d7e2d None None] Enqueued Resource ID: 22a5a995-9907-426f-a4fb-6bba2559c4a3 with Priority: HIGHEST for action port [ 623.765325] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22a5a995-9907-426f-a4fb-6bba2559c4a3 with Priority: HIGHEST for action port [ 623.765636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-22a5a995-9907-426f-a4fb-6bba2559c4a3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.765763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22a5a995-9907-426f-a4fb-6bba2559c4a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.765851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22a5a995-9907-426f-a4fb-6bba2559c4a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.766429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22a5a995-9907-426f-a4fb-6bba2559c4a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.766429] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a5a995-9907-426f-a4fb-6bba2559c4a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.852135] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48d4550e-7022-4b19-b989-d2222eefafbc [ 623.852135] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.852601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.852601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.852676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.852770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.852866] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48d4550e-7022-4b19-b989-d2222eefafbc already deleted. [ 623.853081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48d4550e-7022-4b19-b989-d2222eefafbc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.269879] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22a5a995-9907-426f-a4fb-6bba2559c4a3 [ 624.270132] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.271039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.271039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.271039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.271039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.271039] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22a5a995-9907-426f-a4fb-6bba2559c4a3 already deleted. [ 624.271039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22a5a995-9907-426f-a4fb-6bba2559c4a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.602634] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff in Status: SUCCESS [ 624.603044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.391058] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b2893e7c-86fd-4776-bc62-37ba85544fb8 None None] Enqueued Resource ID: 4ead12ff-17b0-4a93-874c-4fc5cd48ddc9 with Priority: HIGHEST for action port [ 625.391058] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ead12ff-17b0-4a93-874c-4fc5cd48ddc9 with Priority: HIGHEST for action port [ 625.391058] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ead12ff-17b0-4a93-874c-4fc5cd48ddc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.391341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ead12ff-17b0-4a93-874c-4fc5cd48ddc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.393588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ead12ff-17b0-4a93-874c-4fc5cd48ddc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.393588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ead12ff-17b0-4a93-874c-4fc5cd48ddc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.394175] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ead12ff-17b0-4a93-874c-4fc5cd48ddc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.902096] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ead12ff-17b0-4a93-874c-4fc5cd48ddc9 [ 625.902387] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.902484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.902550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.902770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.903262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.903262] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ead12ff-17b0-4a93-874c-4fc5cd48ddc9 already deleted. [ 625.903262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ead12ff-17b0-4a93-874c-4fc5cd48ddc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.758460] env[65630]: INFO networking_nsxv3.common.synchronization [None req-fd4d3be7-6c46-45bf-91be-2955d4d62f60 None None] Enqueued Resource ID: 2c8ad3f5-6fc7-468b-ad02-49075eac537f with Priority: HIGHEST for action port [ 626.758737] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ad3f5-6fc7-468b-ad02-49075eac537f with Priority: HIGHEST for action port [ 626.758939] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c8ad3f5-6fc7-468b-ad02-49075eac537f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.759287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c8ad3f5-6fc7-468b-ad02-49075eac537f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.759368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c8ad3f5-6fc7-468b-ad02-49075eac537f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.759787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c8ad3f5-6fc7-468b-ad02-49075eac537f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.760088] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c8ad3f5-6fc7-468b-ad02-49075eac537f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.263052] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c8ad3f5-6fc7-468b-ad02-49075eac537f [ 627.263451] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.263604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.263672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.264108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.264616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.264616] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c8ad3f5-6fc7-468b-ad02-49075eac537f already deleted. [ 627.264616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c8ad3f5-6fc7-468b-ad02-49075eac537f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.750918] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5dffe582-6cd5-4af8-8f00-e7d26344e352 None None] Enqueued Resource ID: c94f79d3-9ffd-4762-b1eb-453f31cdbb1d with Priority: HIGHEST for action port [ 627.751808] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94f79d3-9ffd-4762-b1eb-453f31cdbb1d with Priority: HIGHEST for action port [ 627.751808] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c94f79d3-9ffd-4762-b1eb-453f31cdbb1d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.752116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c94f79d3-9ffd-4762-b1eb-453f31cdbb1d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.752411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c94f79d3-9ffd-4762-b1eb-453f31cdbb1d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.752690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c94f79d3-9ffd-4762-b1eb-453f31cdbb1d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.752805] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c94f79d3-9ffd-4762-b1eb-453f31cdbb1d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.257900] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c94f79d3-9ffd-4762-b1eb-453f31cdbb1d [ 628.258415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.258694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.259483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.261127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.261127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.261127] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c94f79d3-9ffd-4762-b1eb-453f31cdbb1d already deleted. [ 628.261127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c94f79d3-9ffd-4762-b1eb-453f31cdbb1d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.639894] env[65630]: INFO networking_nsxv3.common.synchronization [req-fe51eca4-bb6b-4047-a38b-634db7089d20 req-f3cf58ca-db50-48ee-9618-c0fbeaae64d6 tempest-InstanceActionsNegativeTestJSON-1796371831 tempest-InstanceActionsNegativeTestJSON-1796371831-project-member] Enqueued Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_members [ 629.641571] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_members [ 629.642583] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.642583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.642583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.643239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.643239] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.643835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.644196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.644274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.644669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.644817] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.148275] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.148452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.148492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.148748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.148843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.149051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.149156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.149217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.149456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.149456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.149569] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d21511b-a9da-4941-a727-0448d9306e2b already deleted. [ 630.149650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.181748] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-206 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.181963] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-206" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.182195] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-206" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.182562] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-206" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.182651] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.182794] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.182895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.183135] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.183749] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.183749] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.183749] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.183749] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.183749] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.184039] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.184039] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.184122] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.205797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.205797] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.206050] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.206127] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-206" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.206444] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.206629] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.206746] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.207292] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.207292] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.245830] env[65630]: INFO networking_nsxv3.common.synchronization [None req-3300362c-1289-40b0-b015-7936a52733c1 None None] Enqueued Resource ID: 4982305a-d155-4687-858e-3dddc1b5cd46 with Priority: HIGHEST for action port [ 630.246101] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4982305a-d155-4687-858e-3dddc1b5cd46 with Priority: HIGHEST for action port [ 630.246721] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4982305a-d155-4687-858e-3dddc1b5cd46 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.246783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4982305a-d155-4687-858e-3dddc1b5cd46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.246862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4982305a-d155-4687-858e-3dddc1b5cd46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.247120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4982305a-d155-4687-858e-3dddc1b5cd46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.247207] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4982305a-d155-4687-858e-3dddc1b5cd46',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.712040] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.712040] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd not found, creating... [ 630.712040] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.712040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.712682] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.712682] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.712682] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.712682] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.712682] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.712682] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd is going to be created. [ 630.742746] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.742848] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.742973] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.743250] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.743467] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.743682] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.752340] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4982305a-d155-4687-858e-3dddc1b5cd46 [ 630.752577] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.752717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.752816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.753066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.753163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.753276] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4982305a-d155-4687-858e-3dddc1b5cd46 already deleted. [ 630.753343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4982305a-d155-4687-858e-3dddc1b5cd46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.796613] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e6560a33-756e-4822-abdd-473044dfe511 tempest-ServersTestBootFromVolume-671027587 tempest-ServersTestBootFromVolume-671027587-project-member] Enqueued Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_rules [ 630.797599] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_rules [ 630.797641] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.797782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.797845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.798144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.798230] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.290452] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7568fb0d-e540-4b56-8053-9d0b9aa9a47e None None] Enqueued Resource ID: 26bd7529-ddc8-4746-8de0-b4446494084a with Priority: HIGHEST for action port [ 631.290708] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26bd7529-ddc8-4746-8de0-b4446494084a with Priority: HIGHEST for action port [ 631.292027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-26bd7529-ddc8-4746-8de0-b4446494084a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.292027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26bd7529-ddc8-4746-8de0-b4446494084a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.292027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26bd7529-ddc8-4746-8de0-b4446494084a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.292682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26bd7529-ddc8-4746-8de0-b4446494084a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.292682] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26bd7529-ddc8-4746-8de0-b4446494084a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.318568] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.319337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.319337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.319337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.319337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.319337] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d already deleted. [ 631.319337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.546413] env[65630]: INFO networking_nsxv3.common.synchronization [req-fe51eca4-bb6b-4047-a38b-634db7089d20 req-dc51c406-a006-4028-ad11-8593cadd30a9 service nova] Enqueued Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_rules [ 631.546585] env[65630]: INFO networking_nsxv3.common.synchronization [req-fe51eca4-bb6b-4047-a38b-634db7089d20 req-dc51c406-a006-4028-ad11-8593cadd30a9 service nova] Enqueued Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_members [ 631.546715] env[65630]: INFO networking_nsxv3.common.synchronization [req-fe51eca4-bb6b-4047-a38b-634db7089d20 req-dc51c406-a006-4028-ad11-8593cadd30a9 service nova] Enqueued Resource ID: 2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd with Priority: HIGHEST for action port [ 631.547239] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_rules [ 631.547372] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_members [ 631.547467] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd with Priority: HIGHEST for action port [ 631.547754] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.547874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.547939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.548342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.548444] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.549242] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.549356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.549423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.549590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.550060] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.550167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.550248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.550400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.550488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.550576] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.551665] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.551665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.551665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.551812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.551812] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.638895] env[65630]: INFO networking_nsxv3.common.synchronization [None req-874ae091-cff4-4d6a-babe-dbf1c0486240 tempest-ServersTestBootFromVolume-671027587 tempest-ServersTestBootFromVolume-671027587-project-member] Enqueued Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_rules [ 631.638895] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_rules [ 631.639348] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.639485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.639552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.639796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.639878] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.794608] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26bd7529-ddc8-4746-8de0-b4446494084a [ 631.794608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.794608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.794608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.794984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.795135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.795307] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26bd7529-ddc8-4746-8de0-b4446494084a already deleted. [ 631.795433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26bd7529-ddc8-4746-8de0-b4446494084a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.053441] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.054562] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.054642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.054795] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd with status ACTIVE [ 632.054942] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.055056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.055120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.055984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.055984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.055984] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.055984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.055984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.055984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.055984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.056274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.056274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.056274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.056402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.056494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.056528] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd is going to be updated. [ 632.068063] env[65630]: INFO networking_nsxv3.common.synchronization [None req-236ad265-0336-4ec6-9a1d-764b5e33f0e4 tempest-ServersWithSpecificFlavorTestJSON-478407304 tempest-ServersWithSpecificFlavorTestJSON-478407304-project-member] Enqueued Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_rules [ 632.070431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_rules [ 632.070877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.071098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.071155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.071477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.071628] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.083527] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.083675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.083773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.083960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.084124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.084288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2501d534-f6f0-4f0c-98f4-9a32a3bf6dbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.170080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.170304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.170689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.170689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.170788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.170834] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d already deleted. [ 632.170948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.480496] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9394fceb-bd56-412e-a1de-98542483ac4e tempest-ServersWithSpecificFlavorTestJSON-478407304 tempest-ServersWithSpecificFlavorTestJSON-478407304-project-member] Enqueued Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_rules [ 632.480496] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_rules [ 632.480496] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.480496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.560296] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.620135] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.620395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.620395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.620600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.620891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.621191] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d already deleted. [ 632.621286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.621418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.621619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.621727] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.063174] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.063718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.063718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.063718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.063718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.063899] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d21511b-a9da-4941-a727-0448d9306e2b is going to be created. [ 633.094737] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.094936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.095776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.096036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.096327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.110545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d21511b-a9da-4941-a727-0448d9306e2b in Status: UNINITIALIZED for 2s [ 633.144170] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.144495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.144495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.144865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.144865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.144865] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d already deleted. [ 633.145969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.171961] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5875315b-804e-44f3-948a-382324bccfa2 None None] Enqueued Resource ID: b83737ce-84f1-48ae-8cf5-e1d960c6f9a6 with Priority: HIGHEST for action port [ 633.171961] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b83737ce-84f1-48ae-8cf5-e1d960c6f9a6 with Priority: HIGHEST for action port [ 633.173524] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b83737ce-84f1-48ae-8cf5-e1d960c6f9a6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.173524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b83737ce-84f1-48ae-8cf5-e1d960c6f9a6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.173524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b83737ce-84f1-48ae-8cf5-e1d960c6f9a6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.173524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b83737ce-84f1-48ae-8cf5-e1d960c6f9a6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.173524] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b83737ce-84f1-48ae-8cf5-e1d960c6f9a6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.208993] env[65630]: INFO networking_nsxv3.common.synchronization [req-3987b3b5-23d0-452f-b9d0-63510e54d918 req-e6b14efb-5a18-45a1-9ad1-65d4ce002464 tempest-VolumesAssistedSnapshotsTest-482920267 tempest-VolumesAssistedSnapshotsTest-482920267-project-member] Enqueued Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_members [ 633.209532] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_members [ 633.209953] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.210270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.210270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.210518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.211105] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.211236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.211343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.211593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.211718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.211826] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.680884] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b83737ce-84f1-48ae-8cf5-e1d960c6f9a6 [ 633.680884] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.680884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.681130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.681530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.681530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.681530] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b83737ce-84f1-48ae-8cf5-e1d960c6f9a6 already deleted. [ 633.681652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b83737ce-84f1-48ae-8cf5-e1d960c6f9a6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.713852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.714026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.714106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.714583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.714683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.714886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.714989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.715066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.715225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.715302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.715389] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 already deleted. [ 633.715470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.832082] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.833264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-108" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.833264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-108" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.833264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-108" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.833264] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.833264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.833264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.833603] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.833603] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.833938] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.833938] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.834093] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.835113] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.835113] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.835113] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.835287] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.856540] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.857515] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.857515] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.857691] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-108" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.858142] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-63d124a4-3abd-4ab7-9531-3b9e63935d15 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.858370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.858540] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.861076] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.861076] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63d124a4-3abd-4ab7-9531-3b9e63935d15',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.363190] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.363636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.363636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.363823] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.363972] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.364240] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 63d124a4-3abd-4ab7-9531-3b9e63935d15 not found, creating... [ 634.364410] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.364657] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.364864] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.365199] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.365199] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.365343] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.365466] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.365673] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.365782] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.365907] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.366104] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 63d124a4-3abd-4ab7-9531-3b9e63935d15 is going to be created. [ 634.388371] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.388578] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.388691] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.389037] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.389275] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.389533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.121831] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d21511b-a9da-4941-a727-0448d9306e2b in Status: SUCCESS [ 635.122086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.122265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.122695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.122894] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.123060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.123155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.123271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.124344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.124496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.124655] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.171694] env[65630]: INFO networking_nsxv3.common.synchronization [req-3987b3b5-23d0-452f-b9d0-63510e54d918 req-b0c20174-af36-4a93-ab1d-57607bc15c0f service nova] Enqueued Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_rules [ 635.171694] env[65630]: INFO networking_nsxv3.common.synchronization [req-3987b3b5-23d0-452f-b9d0-63510e54d918 req-b0c20174-af36-4a93-ab1d-57607bc15c0f service nova] Enqueued Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_members [ 635.172044] env[65630]: INFO networking_nsxv3.common.synchronization [req-3987b3b5-23d0-452f-b9d0-63510e54d918 req-b0c20174-af36-4a93-ab1d-57607bc15c0f service nova] Enqueued Resource ID: 63d124a4-3abd-4ab7-9531-3b9e63935d15 with Priority: HIGHEST for action port [ 635.172423] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_rules [ 635.172565] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_members [ 635.172662] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d124a4-3abd-4ab7-9531-3b9e63935d15 with Priority: HIGHEST for action port [ 635.173102] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.173102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.173230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.173343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.173423] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.175074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.175074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.175074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.175216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.175346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.175416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.175612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.175612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.175765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.175765] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.176741] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-63d124a4-3abd-4ab7-9531-3b9e63935d15 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.176741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.179149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.179149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.179149] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63d124a4-3abd-4ab7-9531-3b9e63935d15',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.478915] env[65630]: INFO networking_nsxv3.common.synchronization [req-2dec64d4-5a3a-476d-8414-d24b2ccfa738 req-a0b41615-432f-4245-9e7a-2c88f303a825 tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 635.479371] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 635.479789] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.479919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.479919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.480286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.480463] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.480639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.480737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.480934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.481023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.481185] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.628837] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.628837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.629141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.629209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.629392] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.629497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.629628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.629761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.629949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.630020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.630229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.630388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.630653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.630727] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.630864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.631017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.631092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.631173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.631263] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.680253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.680415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.681049] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.682164] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63d124a4-3abd-4ab7-9531-3b9e63935d15 with status ACTIVE [ 635.682349] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.682471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.682536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.682755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.682885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.683112] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.683691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.683772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.683983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.684151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.685000] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.685000] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.685000] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.685000] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.685000] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.685000] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63d124a4-3abd-4ab7-9531-3b9e63935d15 is going to be updated. [ 635.719911] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.720838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.720838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.720838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.721012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.721180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63d124a4-3abd-4ab7-9531-3b9e63935d15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.983416] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.983625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.983625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.983766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.983864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.984100] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.984207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.984273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.984435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.984511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.984595] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 already deleted. [ 635.984693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.095082] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-492 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.095290] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.095415] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.095744] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.096037] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.096266] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.096388] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.096605] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.096745] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.096960] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.097087] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.097191] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.097292] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.097396] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.097942] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.098181] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.118612] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.118782] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.118913] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.119173] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.119494] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-d783f708-a33b-44c6-aac8-b993f6ff66b1 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.119783] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.119837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.120247] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.120359] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d783f708-a33b-44c6-aac8-b993f6ff66b1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.133948] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d21511b-a9da-4941-a727-0448d9306e2b: rpc.has_security_group_logging(os_id): False [ 636.153052] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.153244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.153336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.153598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.153750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.154090] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.154090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.154275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.154350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.154451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.154711] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.154834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.154915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.155108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.155206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.155433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.155552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.155633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.155809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.155905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.156032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d21511b-a9da-4941-a727-0448d9306e2b is going to be created. [ 636.182793] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.221755] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.221927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.221958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.222166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.222340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.234013] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d21511b-a9da-4941-a727-0448d9306e2b in Status: IN_PROGRESS for 2s [ 636.625749] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.626122] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.626122] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.626616] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.626894] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.628248] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port d783f708-a33b-44c6-aac8-b993f6ff66b1 not found, creating... [ 636.628248] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.628248] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.628248] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.628248] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.628248] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.628554] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.628775] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.628962] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.629253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.629396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.629565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: d783f708-a33b-44c6-aac8-b993f6ff66b1 is going to be created. [ 636.654299] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.655790] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.655790] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.655790] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.655790] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.655790] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.685219] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.685628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.685726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.686055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.686055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.686147] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 is going to be created. [ 636.735539] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.735936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.736070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.736388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.736620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.755223] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 in Status: UNINITIALIZED for 2s [ 637.545864] env[65630]: INFO networking_nsxv3.common.synchronization [req-2dec64d4-5a3a-476d-8414-d24b2ccfa738 req-92fbc502-4ebf-428d-b8d4-343ceeee9f81 service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 637.545965] env[65630]: INFO networking_nsxv3.common.synchronization [req-2dec64d4-5a3a-476d-8414-d24b2ccfa738 req-92fbc502-4ebf-428d-b8d4-343ceeee9f81 service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 637.548377] env[65630]: INFO networking_nsxv3.common.synchronization [req-2dec64d4-5a3a-476d-8414-d24b2ccfa738 req-92fbc502-4ebf-428d-b8d4-343ceeee9f81 service nova] Enqueued Resource ID: d783f708-a33b-44c6-aac8-b993f6ff66b1 with Priority: HIGHEST for action port [ 637.550217] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 637.550492] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 637.551345] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d783f708-a33b-44c6-aac8-b993f6ff66b1 with Priority: HIGHEST for action port [ 637.551345] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.551595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.551595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.551898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.552009] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.554334] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.554531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.554609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.554804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.554982] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.555125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.555190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.555364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.555595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.555737] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.559123] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d783f708-a33b-44c6-aac8-b993f6ff66b1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.559245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.559353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.559656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.559656] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d783f708-a33b-44c6-aac8-b993f6ff66b1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.891810] env[65630]: INFO networking_nsxv3.common.synchronization [req-9b6a518e-2879-46d5-af4a-d4ee74465f9d req-b9a089de-35a7-4366-952b-e4b256b36f3d tempest-TenantUsagesTestJSON-717349194 tempest-TenantUsagesTestJSON-717349194-project-member] Enqueued Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_members [ 637.893378] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_members [ 637.893378] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.893378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.896961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.896961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.896961] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.896961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.896961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.896961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.896961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.896961] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.062868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.063112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.063220] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.064521] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d783f708-a33b-44c6-aac8-b993f6ff66b1 with status ACTIVE [ 638.064727] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.064854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.064917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.065138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.065242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.065455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.065575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.065630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.066155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.066155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.066308] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.066460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.066670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.067642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.067642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.067642] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d783f708-a33b-44c6-aac8-b993f6ff66b1 is going to be updated. [ 638.098164] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.098164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.098164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.098164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.098164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.098928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d783f708-a33b-44c6-aac8-b993f6ff66b1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.258786] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d21511b-a9da-4941-a727-0448d9306e2b in Status: SUCCESS [ 638.258786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.405342] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.406096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.406096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.406096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.406735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.406816] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.406995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.407145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.407830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.407830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.407981] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4db90ff6-65fb-428b-b489-30d9d407642e already deleted. [ 638.408050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.430743] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.431093] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.431744] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.432142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.432473] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.432614] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.432718] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.432952] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.433132] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.433316] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.433438] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.433531] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.433665] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.433728] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.433830] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.434089] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.452754] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.453011] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.453182] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.453427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.453791] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-ca8399f2-a2e7-4466-8923-d42374d77f02 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.453995] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.454162] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.454522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.454703] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca8399f2-a2e7-4466-8923-d42374d77f02',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.571550] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.766570] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 in Status: SUCCESS [ 638.767143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.767494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.767864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.768217] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.768424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.768555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.768750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.768834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.768923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.769138] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.958594] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.958915] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.958972] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.959349] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.959428] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.959556] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port ca8399f2-a2e7-4466-8923-d42374d77f02 not found, creating... [ 638.959884] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.960055] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.960159] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.960389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.960521] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.960846] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.961027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.961153] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.961408] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.961486] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.961617] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: ca8399f2-a2e7-4466-8923-d42374d77f02 is going to be created. [ 638.983503] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.983821] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.983920] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.984139] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.984376] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.984607] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.074886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.074886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.075237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.075237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.075337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.075369] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be created. [ 639.132277] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.132463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.132538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.132756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.132913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.144641] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: UNINITIALIZED for 2s [ 639.271170] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.762242] env[65630]: INFO networking_nsxv3.common.synchronization [req-9b6a518e-2879-46d5-af4a-d4ee74465f9d req-e29b88d1-ef89-44f2-95c0-47fe5f621d16 service nova] Enqueued Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_rules [ 639.762439] env[65630]: INFO networking_nsxv3.common.synchronization [req-9b6a518e-2879-46d5-af4a-d4ee74465f9d req-e29b88d1-ef89-44f2-95c0-47fe5f621d16 service nova] Enqueued Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_members [ 639.762590] env[65630]: INFO networking_nsxv3.common.synchronization [req-9b6a518e-2879-46d5-af4a-d4ee74465f9d req-e29b88d1-ef89-44f2-95c0-47fe5f621d16 service nova] Enqueued Resource ID: ca8399f2-a2e7-4466-8923-d42374d77f02 with Priority: HIGHEST for action port [ 639.763176] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_rules [ 639.763336] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_members [ 639.763439] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8399f2-a2e7-4466-8923-d42374d77f02 with Priority: HIGHEST for action port [ 639.763745] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.763860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.763938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.764574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.764574] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.765982] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.766120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.766183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.766427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.766523] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.766604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.766666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.767233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.767233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.767233] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.768029] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca8399f2-a2e7-4466-8923-d42374d77f02 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.768502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.769303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.769303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.769303] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca8399f2-a2e7-4466-8923-d42374d77f02',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.773056] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a2bd5a-73f9-4706-b4d6-3b2079addc81: rpc.has_security_group_logging(os_id): False [ 639.796028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.796028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.796028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.798020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.798020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.798020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.798020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.798020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.798020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.798020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.798020] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 is going to be created. [ 639.871603] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.872176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.872176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.872328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.872511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.887132] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 in Status: IN_PROGRESS for 2s [ 640.267416] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.267416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.272085] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca8399f2-a2e7-4466-8923-d42374d77f02 with status ACTIVE [ 640.272298] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.272441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.272510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.272740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.272834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.274346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.274463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.274524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.274722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.274809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.275007] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.275124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.275313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.275313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.275405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.275475] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca8399f2-a2e7-4466-8923-d42374d77f02 is going to be updated. [ 640.277455] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.307098] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.307330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.307408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.307708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.311379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.311379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca8399f2-a2e7-4466-8923-d42374d77f02" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.781211] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.062153] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a1848fd-428b-40b5-bf53-69826588eb92 req-eb47f2f7-e782-4e3c-9470-76e473a8aead tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 641.063102] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 641.063552] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.063782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.160170] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 641.160170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.160170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.160170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.160170] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.160539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.160539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.160539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.160648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.160685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.160878] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.161687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.164211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.164211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.164211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.164211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.164211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.164211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.164211] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.285880] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.286193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.286638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.287203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.287203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.287203] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4db90ff6-65fb-428b-b489-30d9d407642e is going to be created. [ 641.317485] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.317485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.317485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.317485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.317485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.327190] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4db90ff6-65fb-428b-b489-30d9d407642e in Status: UNINITIALIZED for 2s [ 641.598898] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-492 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.599116] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.599241] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.599530] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.599782] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.599946] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.600080] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.600304] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.600446] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.600652] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.600757] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.600863] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.600998] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.601187] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.601298] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.601430] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.623736] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.623736] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.623736] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.623736] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.623736] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-7555a105-3d28-4c1b-a1d6-85e11e09629f taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.623736] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.623736] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.624035] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.624197] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7555a105-3d28-4c1b-a1d6-85e11e09629f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.664180] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.664315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.664522] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.899855] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 in Status: SUCCESS [ 641.900783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.127226] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.127226] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.127444] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.127722] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.127885] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.128137] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 7555a105-3d28-4c1b-a1d6-85e11e09629f not found, creating... [ 642.128426] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.128588] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.128714] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.129110] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.129260] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.129611] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.129827] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.129955] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.130436] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.130509] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.130652] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 7555a105-3d28-4c1b-a1d6-85e11e09629f is going to be created. [ 642.153485] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.153686] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.153801] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.154104] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.154319] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.154524] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.167268] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.670672] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.671073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.671073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.671164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.671227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.671336] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 642.719389] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.719562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.719685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.719911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.720056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.731140] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 642.906846] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a1848fd-428b-40b5-bf53-69826588eb92 req-df3c8830-9409-4011-b3c5-f85b8e34fbb4 service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 642.906846] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a1848fd-428b-40b5-bf53-69826588eb92 req-df3c8830-9409-4011-b3c5-f85b8e34fbb4 service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 642.906846] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a1848fd-428b-40b5-bf53-69826588eb92 req-df3c8830-9409-4011-b3c5-f85b8e34fbb4 service nova] Enqueued Resource ID: 7555a105-3d28-4c1b-a1d6-85e11e09629f with Priority: HIGHEST for action port [ 642.907187] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 642.908840] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 642.909059] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7555a105-3d28-4c1b-a1d6-85e11e09629f with Priority: HIGHEST for action port [ 642.909539] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.909653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.910337] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.910438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.910683] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-7555a105-3d28-4c1b-a1d6-85e11e09629f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.910821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.910881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.911108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.911204] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7555a105-3d28-4c1b-a1d6-85e11e09629f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.344606] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4db90ff6-65fb-428b-b489-30d9d407642e in Status: SUCCESS [ 643.344606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.344606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.344606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.344877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.344961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.345036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.345143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.345216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.346779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.346779] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.414345] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7555a105-3d28-4c1b-a1d6-85e11e09629f with status ACTIVE [ 643.414650] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.415028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.415028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.415188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.416860] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.416860] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.416860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.416860] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7555a105-3d28-4c1b-a1d6-85e11e09629f is going to be updated. [ 643.442422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.442566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.442641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.443480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.443480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.443480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7555a105-3d28-4c1b-a1d6-85e11e09629f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.665705] env[65630]: INFO networking_nsxv3.common.synchronization [req-a93d2341-9141-4e7d-8bf5-a954d905f87d req-867eabcd-9382-47ae-83b8-482ba0785d78 tempest-VolumesAdminNegativeTest-1141332750 tempest-VolumesAdminNegativeTest-1141332750-project-member] Enqueued Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_members [ 643.671903] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_members [ 643.672354] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.672496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.672554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.672844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.673022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.673135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.673196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.673347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.673434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.673517] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.850516] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.850751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.850892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.851285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.851600] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.851759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.851886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.852151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.852391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.852539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.852785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.853084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.853531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.854651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.854900] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.854960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.855167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.855359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.855453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.855542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.855652] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.122661] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.122813] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.122863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.125787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.125787] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.125787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.125787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.125787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.125787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.125787] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.125787] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.125787] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.125787] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.125787] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.125787] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.125787] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.147875] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.148336] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.148336] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.148546] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.149627] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.149627] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.149627] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.150392] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.150525] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.180793] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.180793] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.180793] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 already deleted. [ 644.180793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.363163] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4db90ff6-65fb-428b-b489-30d9d407642e: rpc.has_security_group_logging(os_id): False [ 644.382038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.382265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.382333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.382550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.382623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.382857] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.383129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.383215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.383489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.383587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.383874] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.383989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.384390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.384583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.384657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.384838] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.384942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.385018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.385160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.385240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.385324] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4db90ff6-65fb-428b-b489-30d9d407642e is going to be created. [ 644.451476] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.451476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.451476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.451476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.451476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.465132] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4db90ff6-65fb-428b-b489-30d9d407642e in Status: IN_PROGRESS for 2s [ 644.655653] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.655653] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.655653] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.655959] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.655959] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.656168] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 not found, creating... [ 644.657130] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.657130] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.657130] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.657130] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.657324] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.657652] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.657841] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.657964] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.658242] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.658428] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.658636] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 is going to be created. [ 644.682873] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.683303] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.683303] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.683520] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.683808] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.684081] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.745643] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 644.745643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.745840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.746589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.746881] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.747049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.747049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.747607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.747607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.747607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.747607] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.747787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.747787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.747997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.748126] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.748251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.748319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.748473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.748539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.748626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.748714] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.749656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.750289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.750289] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.750289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.750289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.750537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.750537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.750594] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.252334] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e647f36-5543-4052-8cd2-b972c5bc69c3: rpc.has_security_group_logging(os_id): False [ 645.253540] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.274315] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.274315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.274315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.274752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.274810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.275144] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.275144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.275265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.275359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.275434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.275609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.275702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.275760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.275903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.275976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.276176] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.276268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.276328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.276471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.276560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.276624] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be created. [ 645.336720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.336943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.336943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.337230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.337352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.350445] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 645.381631] env[65630]: INFO networking_nsxv3.common.synchronization [req-a93d2341-9141-4e7d-8bf5-a954d905f87d req-bd164fdc-53bf-4422-97d7-d99832911439 service nova] Enqueued Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_rules [ 645.381912] env[65630]: INFO networking_nsxv3.common.synchronization [req-a93d2341-9141-4e7d-8bf5-a954d905f87d req-bd164fdc-53bf-4422-97d7-d99832911439 service nova] Enqueued Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_members [ 645.381992] env[65630]: INFO networking_nsxv3.common.synchronization [req-a93d2341-9141-4e7d-8bf5-a954d905f87d req-bd164fdc-53bf-4422-97d7-d99832911439 service nova] Enqueued Resource ID: ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 with Priority: HIGHEST for action port [ 645.383180] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_rules [ 645.383400] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_members [ 645.383513] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 with Priority: HIGHEST for action port [ 645.384267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.384516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.384516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.384727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.384812] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.385782] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.386151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.386224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.386421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.386595] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.386700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.386761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.386914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.386993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.387097] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.391458] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.391458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.391458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.391458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.391458] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.756194] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.891228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.891381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.891653] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.896705] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 with status ACTIVE [ 645.896705] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.896705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.896705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.896705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.896705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.896705] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.896705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.896705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.897260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.897260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.897260] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.897260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.897260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.897414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.898445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.898445] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631 is going to be updated. [ 645.927673] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.927984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.927984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.928482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.928482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.928594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2f2b8f-a7c1-4f2d-82cf-8dac123a7631" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.250584] env[65630]: INFO networking_nsxv3.common.synchronization [req-8d1c8e4b-a47c-4574-9096-f1aa66a8eb81 req-64082ada-6492-4310-ba59-65f21d61db76 tempest-ServerDiagnosticsTest-1694489187 tempest-ServerDiagnosticsTest-1694489187-project-member] Enqueued Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_members [ 646.253779] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_members [ 646.255171] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.255171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.255171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.255411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.255926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.256107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.256173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.256423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.256529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.256655] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.259250] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.259412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.259508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.260067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.260067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.260067] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 646.294690] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.294845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.294986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.295167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.295333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.311095] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 646.396624] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.479503] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4db90ff6-65fb-428b-b489-30d9d407642e in Status: SUCCESS [ 646.479871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.760353] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.760353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.760353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.760801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.760801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.760801] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.761195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.761195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.761358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.761492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.761657] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f85ab7-23ea-4874-b442-58c60cf9adee already deleted. [ 646.761752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.900051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.900051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.900051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.900317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.900352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.900433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 is going to be created. [ 646.929964] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.930215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.930309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.930534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.930697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.941980] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 in Status: UNINITIALIZED for 2s [ 647.012943] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.013192] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.013317] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.013586] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.013833] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.013982] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.014106] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.014326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.014464] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.014697] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.014807] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.014913] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.015052] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.015163] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.015287] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.015427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.035929] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.036328] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.036328] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.036494] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.036835] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-304d4de9-4399-44bd-87f1-f5d570ad4f91 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.036990] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.037116] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.037436] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.037569] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304d4de9-4399-44bd-87f1-f5d570ad4f91',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.370972] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 647.371322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.371580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.371861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.371990] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.540701] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.541040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.541144] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.541449] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.541638] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.541800] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 304d4de9-4399-44bd-87f1-f5d570ad4f91 not found, creating... [ 647.542084] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.542321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.542420] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.542666] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.542805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.543140] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.543315] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.543427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.543662] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.543810] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.543941] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 304d4de9-4399-44bd-87f1-f5d570ad4f91 is going to be created. [ 647.565786] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.566090] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.566163] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.566468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.566725] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.567032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.874890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.875199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.294904] env[65630]: INFO networking_nsxv3.common.synchronization [req-8d1c8e4b-a47c-4574-9096-f1aa66a8eb81 req-11bbce1c-9275-4948-956a-870507e955f2 service nova] Enqueued Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_rules [ 648.295104] env[65630]: INFO networking_nsxv3.common.synchronization [req-8d1c8e4b-a47c-4574-9096-f1aa66a8eb81 req-11bbce1c-9275-4948-956a-870507e955f2 service nova] Enqueued Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_members [ 648.295285] env[65630]: INFO networking_nsxv3.common.synchronization [req-8d1c8e4b-a47c-4574-9096-f1aa66a8eb81 req-11bbce1c-9275-4948-956a-870507e955f2 service nova] Enqueued Resource ID: 304d4de9-4399-44bd-87f1-f5d570ad4f91 with Priority: HIGHEST for action port [ 648.297250] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_rules [ 648.297541] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_members [ 648.297761] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 304d4de9-4399-44bd-87f1-f5d570ad4f91 with Priority: HIGHEST for action port [ 648.298225] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.298428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.298531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.299095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.300020] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.300444] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.300623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.300704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.300999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.301761] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.301978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.302086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.302373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.302495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.302609] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.303952] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-304d4de9-4399-44bd-87f1-f5d570ad4f91 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.304174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.304212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.304457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.304614] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304d4de9-4399-44bd-87f1-f5d570ad4f91',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.325170] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 648.325405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.326227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.326227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.326486] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.326720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.326922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.327061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.327162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.327313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.327497] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.807392] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.807522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.807731] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.813627] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 304d4de9-4399-44bd-87f1-f5d570ad4f91 with status ACTIVE [ 648.813627] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.813627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.813627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.813787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.813877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.816234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.816234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.816234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.817030] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 304d4de9-4399-44bd-87f1-f5d570ad4f91 is going to be updated. [ 648.829447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.830315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.830466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.830852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.831137] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.831252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.831423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.832180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.832180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.832180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.832180] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.832600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.832600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.832600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.832768] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.833287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.833287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.833287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.833416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.833475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.833660] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.841202] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.841387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.841491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.841760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.842221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.842221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-304d4de9-4399-44bd-87f1-f5d570ad4f91" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.956821] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 in Status: SUCCESS [ 648.957289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.957289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.957487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.959304] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.959451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.959451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.959664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.959780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.959911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.959981] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.067713] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e6d5d068-c944-4e47-9c06-b72b9ace3d65 None None] Enqueued Resource ID: b2019b67-ff99-4031-b97f-e04473ca2539 with Priority: HIGHEST for action port [ 649.068446] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2019b67-ff99-4031-b97f-e04473ca2539 with Priority: HIGHEST for action port [ 649.068788] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2019b67-ff99-4031-b97f-e04473ca2539 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.068917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2019b67-ff99-4031-b97f-e04473ca2539" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.068989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2019b67-ff99-4031-b97f-e04473ca2539" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.069375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2019b67-ff99-4031-b97f-e04473ca2539" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.069453] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2019b67-ff99-4031-b97f-e04473ca2539',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.311056] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.338037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e647f36-5543-4052-8cd2-b972c5bc69c3: rpc.has_security_group_logging(os_id): False [ 649.361078] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.361958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.362105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.362544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.362638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.362895] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.363024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.363088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.363345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.363345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.363522] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.363616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.363675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.363837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.363884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.364085] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.364178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.364237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.364397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.364456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.364526] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 649.462184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.462343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.462388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.462622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.462772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.466771] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.466771] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.466771] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.466771] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.466771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.467833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.467833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.467833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.467833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.467833] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.488146] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 649.576071] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2019b67-ff99-4031-b97f-e04473ca2539 [ 649.576256] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.577257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.577257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.579981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.579981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.579981] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2019b67-ff99-4031-b97f-e04473ca2539 already deleted. [ 649.579981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2019b67-ff99-4031-b97f-e04473ca2539" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.814362] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.814541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.814813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.814951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.814951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.815065] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f85ab7-23ea-4874-b442-58c60cf9adee is going to be created. [ 649.844842] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.844842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.844842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.844842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.844842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.857396] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f85ab7-23ea-4874-b442-58c60cf9adee in Status: UNINITIALIZED for 2s [ 649.969639] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cd1c6ab-c111-4ed9-adb8-faa330316c36: rpc.has_security_group_logging(os_id): False [ 649.995824] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.995824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.995824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.995824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.995824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.995824] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.996113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.996113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.996182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.996214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.996374] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.996514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.996514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.996648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.996716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.996951] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.998102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.998395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.000240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.000240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.000240] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 is going to be created. [ 650.023080] env[65630]: INFO networking_nsxv3.common.synchronization [req-46fee9d9-82af-4bdf-8357-d9fc49ba9aad req-0002e691-25fd-4b0b-a921-1534b04ba908 tempest-ServerExternalEventsTest-1404862039 tempest-ServerExternalEventsTest-1404862039-project-member] Enqueued Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_members [ 650.026394] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_members [ 650.026394] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4010c2f-2754-4e2d-949f-ec21a2348a3d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.026394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.026394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.026394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.026394] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.026394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.026394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.026394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.026394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.026394] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.063646] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.063886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.063968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.064263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.064373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.078455] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 in Status: IN_PROGRESS for 2s [ 650.406717] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.406940] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.407051] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.407313] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.407594] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.407810] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.407878] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.408201] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.408201] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.408407] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.408517] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.408617] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.408726] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.408818] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.408911] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.409062] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.436727] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.436963] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.436963] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.437139] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.437487] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.437667] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.437718] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.438218] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.438412] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb46e50c-9f57-4d1c-8432-84f6ef4e683d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.531602] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.531602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.531602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.531602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.531602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.532123] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.532123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.532123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.532353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.532628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.532739] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d already deleted. [ 650.532818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.942594] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.943398] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.943398] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.943950] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.944203] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.944395] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port fb46e50c-9f57-4d1c-8432-84f6ef4e683d not found, creating... [ 650.944844] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.945207] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.945320] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.945586] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.945766] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.946274] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.946638] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.946789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.947219] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.947424] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.947579] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: fb46e50c-9f57-4d1c-8432-84f6ef4e683d is going to be created. [ 650.976805] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.977111] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.977248] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.977543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.977770] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.977997] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.515270] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 651.515686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.736437] env[65630]: INFO networking_nsxv3.common.synchronization [req-46fee9d9-82af-4bdf-8357-d9fc49ba9aad req-c4da1074-c584-4db3-8383-5833ef3e0e45 service nova] Enqueued Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_rules [ 651.736437] env[65630]: INFO networking_nsxv3.common.synchronization [req-46fee9d9-82af-4bdf-8357-d9fc49ba9aad req-c4da1074-c584-4db3-8383-5833ef3e0e45 service nova] Enqueued Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_members [ 651.736437] env[65630]: INFO networking_nsxv3.common.synchronization [req-46fee9d9-82af-4bdf-8357-d9fc49ba9aad req-c4da1074-c584-4db3-8383-5833ef3e0e45 service nova] Enqueued Resource ID: fb46e50c-9f57-4d1c-8432-84f6ef4e683d with Priority: HIGHEST for action port [ 651.740252] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_rules [ 651.740252] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_members [ 651.740252] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb46e50c-9f57-4d1c-8432-84f6ef4e683d with Priority: HIGHEST for action port [ 651.740252] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4010c2f-2754-4e2d-949f-ec21a2348a3d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.740252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.740252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.740252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.740252] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.740252] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4010c2f-2754-4e2d-949f-ec21a2348a3d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.740252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.740674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.740674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.740674] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.740795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.740795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.743286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.743286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.743286] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.743286] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.743286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.743286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.743286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.743286] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb46e50c-9f57-4d1c-8432-84f6ef4e683d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.747748] env[65630]: INFO networking_nsxv3.common.synchronization [None req-86e36397-d31f-4c90-9b9c-e6f7862758e3 None None] Enqueued Resource ID: a55a64b2-77e5-4340-9a84-427319f821e9 with Priority: HIGHEST for action port [ 651.748581] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55a64b2-77e5-4340-9a84-427319f821e9 with Priority: HIGHEST for action port [ 651.748685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a55a64b2-77e5-4340-9a84-427319f821e9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.748794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a55a64b2-77e5-4340-9a84-427319f821e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.748867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a55a64b2-77e5-4340-9a84-427319f821e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.749107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a55a64b2-77e5-4340-9a84-427319f821e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.749196] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a55a64b2-77e5-4340-9a84-427319f821e9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.869422] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f85ab7-23ea-4874-b442-58c60cf9adee in Status: SUCCESS [ 651.869907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.870402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.870513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.870674] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.870823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.870918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.871128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.871226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.871317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.871546] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.068702] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcb8fffd-3aad-4b64-addb-47c2e60afced req-992b1584-0790-41a5-83ce-ed0765c28c4e tempest-ServerMetadataTestJSON-1411665217 tempest-ServerMetadataTestJSON-1411665217-project-member] Enqueued Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_members [ 652.069527] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_members [ 652.069654] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.069849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.069849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.071466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.071787] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.072780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.072780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.073133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.073133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.073226] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.094678] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 in Status: SUCCESS [ 652.095297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.246726] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4010c2f-2754-4e2d-949f-ec21a2348a3d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.246726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.246726] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.250470] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb46e50c-9f57-4d1c-8432-84f6ef4e683d with status ACTIVE [ 652.250470] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.250470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.251451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.251451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.251631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.251748] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.251898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.251998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.252220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.252303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.252550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.252783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.252783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.252950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.254142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.254290] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb46e50c-9f57-4d1c-8432-84f6ef4e683d is going to be updated. [ 652.255674] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a55a64b2-77e5-4340-9a84-427319f821e9 [ 652.255873] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.256020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.256199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.256278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.256374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.256550] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a55a64b2-77e5-4340-9a84-427319f821e9 already deleted. [ 652.257051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a55a64b2-77e5-4340-9a84-427319f821e9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.281862] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.282064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.282224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.283302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.283465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.283678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb46e50c-9f57-4d1c-8432-84f6ef4e683d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.375639] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.375639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.376338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.376622] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.376808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.376917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.377072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.377199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.377331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.377540] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.377669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.377808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.378074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.378252] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.378371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.378465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.378649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.378770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.378980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.379136] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.576753] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.578380] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.578380] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 already deleted. [ 652.578380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.618345] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-975 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.618542] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-975" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.618967] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-975" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.619076] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-975" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.619296] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.619414] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.619532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.620127] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.620127] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.620754] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.621220] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.621515] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.621644] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.621853] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.621932] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.622136] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.643694] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.643694] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.643694] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.643884] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-975" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.644284] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-81633d7b-7aba-488d-9a00-c9fa797aa3d2 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.644637] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.644637] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.645033] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.645212] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81633d7b-7aba-488d-9a00-c9fa797aa3d2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.749547] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.881913] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52f85ab7-23ea-4874-b442-58c60cf9adee: rpc.has_security_group_logging(os_id): False [ 652.902538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.902538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.902794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.902877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.902970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.903279] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.903279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.903488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.903523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.903583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.903774] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.903872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.903959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.904158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.904252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.904477] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.904574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.904633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.904787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.904865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.904981] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f85ab7-23ea-4874-b442-58c60cf9adee is going to be created. [ 652.972298] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.972449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.972519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.972745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.972966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.990251] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f85ab7-23ea-4874-b442-58c60cf9adee in Status: IN_PROGRESS for 2s [ 653.151075] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.151075] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.151693] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.151693] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.151693] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.151886] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 81633d7b-7aba-488d-9a00-c9fa797aa3d2 not found, creating... [ 653.152218] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.152218] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.152519] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.152622] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.152793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.153097] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.153228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.153392] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.153674] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.153674] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.153822] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 81633d7b-7aba-488d-9a00-c9fa797aa3d2 is going to be created. [ 653.190646] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.190646] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.190646] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.190646] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.190646] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.190646] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.256024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.256024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.256024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.256024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.256024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.256024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d is going to be created. [ 653.300027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.300281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.300281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.301049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.301049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.322258] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d in Status: UNINITIALIZED for 2s [ 653.829320] env[65630]: INFO networking_nsxv3.common.synchronization [req-b940f2d7-2a4a-4584-a4d2-64c3841d08f5 req-d90ab56e-94a5-416a-b0c1-a4d027a69fb7 tempest-FloatingIPsAssociationTestJSON-476441825 tempest-FloatingIPsAssociationTestJSON-476441825-project-member] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 653.829320] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 653.829320] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.829320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.829320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.830146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.830529] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.830817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.831077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.831418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.831639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.831857] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.903032] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcb8fffd-3aad-4b64-addb-47c2e60afced req-180faad9-5547-4941-9c0e-7fd21929cdac service nova] Enqueued Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_rules [ 653.903032] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcb8fffd-3aad-4b64-addb-47c2e60afced req-180faad9-5547-4941-9c0e-7fd21929cdac service nova] Enqueued Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_members [ 653.903032] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcb8fffd-3aad-4b64-addb-47c2e60afced req-180faad9-5547-4941-9c0e-7fd21929cdac service nova] Enqueued Resource ID: 81633d7b-7aba-488d-9a00-c9fa797aa3d2 with Priority: HIGHEST for action port [ 653.907022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_rules [ 653.907022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_members [ 653.907022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81633d7b-7aba-488d-9a00-c9fa797aa3d2 with Priority: HIGHEST for action port [ 653.907022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcabb3c1-63c7-4e6e-99e0-7cb17896f367 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.907022] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.907022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.907022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.907022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.907022] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.909729] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-81633d7b-7aba-488d-9a00-c9fa797aa3d2 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.910603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.910808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.911234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.911603] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81633d7b-7aba-488d-9a00-c9fa797aa3d2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.335244] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.414054] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.414054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.414054] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.415059] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81633d7b-7aba-488d-9a00-c9fa797aa3d2 with status ACTIVE [ 654.415059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.415059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.415059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.415364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.415433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.415567] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.415680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.415745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.417324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.417324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.417324] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.417324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.417324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.417324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.417324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.417324] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81633d7b-7aba-488d-9a00-c9fa797aa3d2 is going to be updated. [ 654.446270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.446467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.446467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.446765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.446923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.447106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81633d7b-7aba-488d-9a00-c9fa797aa3d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.471696] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.471879] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.472062] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.472484] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.472776] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.472978] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.473146] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.473395] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.473567] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.473802] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.473892] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.474008] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.474109] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.474214] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.474315] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.474438] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.502899] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.503211] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.503346] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.503602] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-262" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.504070] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.505781] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.505781] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.505922] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.506086] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8efe19-9c83-4c81-bcc8-1a2a4e649e09',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.838823] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.918855] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.005734] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f85ab7-23ea-4874-b442-58c60cf9adee in Status: SUCCESS [ 655.006020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.009780] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.010081] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.010255] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.010569] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.010740] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.010999] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port db8efe19-9c83-4c81-bcc8-1a2a4e649e09 not found, creating... [ 655.011336] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.011452] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.011568] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.011800] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.011940] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.012386] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.012500] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.012586] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.012836] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.012992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.013166] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: db8efe19-9c83-4c81-bcc8-1a2a4e649e09 is going to be created. [ 655.034736] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.034948] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.035088] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.035425] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.035736] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.036250] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.338231] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d in Status: SUCCESS [ 655.338581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.338634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.338853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.339062] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.339185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.339246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.339408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.339490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.339578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.339676] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.340755] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.340880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.340950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.341313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.341437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.341560] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 is going to be updated. [ 655.386555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.386698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.386761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.387145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.387405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.398626] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: IN_PROGRESS for 2s [ 655.422335] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.422513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.422596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.422837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.422948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.423063] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 is going to be created. [ 655.458908] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.459331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.459331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.459545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.459745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.471775] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 in Status: UNINITIALIZED for 2s [ 655.763933] env[65630]: INFO networking_nsxv3.common.synchronization [req-b940f2d7-2a4a-4584-a4d2-64c3841d08f5 req-5d2df1b3-9b4d-43bd-94c7-8bb73f451e04 service nova] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_rules [ 655.763933] env[65630]: INFO networking_nsxv3.common.synchronization [req-b940f2d7-2a4a-4584-a4d2-64c3841d08f5 req-5d2df1b3-9b4d-43bd-94c7-8bb73f451e04 service nova] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 655.764224] env[65630]: INFO networking_nsxv3.common.synchronization [req-b940f2d7-2a4a-4584-a4d2-64c3841d08f5 req-5d2df1b3-9b4d-43bd-94c7-8bb73f451e04 service nova] Enqueued Resource ID: db8efe19-9c83-4c81-bcc8-1a2a4e649e09 with Priority: HIGHEST for action port [ 655.764677] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_rules [ 655.764775] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 655.764902] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8efe19-9c83-4c81-bcc8-1a2a4e649e09 with Priority: HIGHEST for action port [ 655.765350] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.765530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.765661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.765934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.766095] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.767154] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.767321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.767616] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.767843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.769629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.769966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.770086] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8efe19-9c83-4c81-bcc8-1a2a4e649e09',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.843895] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4010c2f-2754-4e2d-949f-ec21a2348a3d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.844149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.844273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.844535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.844812] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.845014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.845134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.845388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.845531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.846201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.846201] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4010c2f-2754-4e2d-949f-ec21a2348a3d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.846201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.846201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.846425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.846679] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.846821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.846920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.848104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.848104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.848823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.848823] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.272566] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.272918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.272918] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db8efe19-9c83-4c81-bcc8-1a2a4e649e09 with status ACTIVE [ 656.273818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.273818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.273818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.273818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.273818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.273818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.273818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.274450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.274450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.274450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.274450] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.274450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.274450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.274732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.274732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.274732] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db8efe19-9c83-4c81-bcc8-1a2a4e649e09 is going to be updated. [ 656.303410] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.303725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.303725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.303874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.304076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.304207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db8efe19-9c83-4c81-bcc8-1a2a4e649e09" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.352666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4010c2f-2754-4e2d-949f-ec21a2348a3d: rpc.has_security_group_logging(os_id): False [ 656.380400] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.380400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.380400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.380663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.380663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.380731] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.380849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.380930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.381159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.381242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.381458] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.381556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.381616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.381763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.381837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.382026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.382125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.382182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.382357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.382433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.382534] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d is going to be created. [ 656.478022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.478022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.478022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.478179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.478872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.499328] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d in Status: IN_PROGRESS for 2s [ 657.080019] env[65630]: INFO networking_nsxv3.common.synchronization [None req-64c302cc-a70e-4de6-8f47-6dcfa4eb622a None None] Enqueued Resource ID: 0ee2a8ee-106e-4497-b520-f9bee7fda54a with Priority: HIGHEST for action port [ 657.080019] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee2a8ee-106e-4497-b520-f9bee7fda54a with Priority: HIGHEST for action port [ 657.080019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ee2a8ee-106e-4497-b520-f9bee7fda54a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.080019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ee2a8ee-106e-4497-b520-f9bee7fda54a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.080019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ee2a8ee-106e-4497-b520-f9bee7fda54a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.081678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ee2a8ee-106e-4497-b520-f9bee7fda54a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.081970] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ee2a8ee-106e-4497-b520-f9bee7fda54a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.183610] env[65630]: INFO networking_nsxv3.common.synchronization [None req-23a794a0-af38-47d6-8148-b676c3ed9d1f None None] Enqueued Resource ID: c07b5469-0677-46ea-bbd6-7fb5c2037b86 with Priority: HIGHEST for action port [ 657.184230] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07b5469-0677-46ea-bbd6-7fb5c2037b86 with Priority: HIGHEST for action port [ 657.184366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c07b5469-0677-46ea-bbd6-7fb5c2037b86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.184488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c07b5469-0677-46ea-bbd6-7fb5c2037b86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.184582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c07b5469-0677-46ea-bbd6-7fb5c2037b86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.184929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c07b5469-0677-46ea-bbd6-7fb5c2037b86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.186020] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c07b5469-0677-46ea-bbd6-7fb5c2037b86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.410876] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: SUCCESS [ 657.411461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.412941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.412941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.413257] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.413801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.413801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.413801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.413974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.414136] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.483939] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 in Status: SUCCESS [ 657.485223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.487039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.487039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.487039] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.487039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.487039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.487039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.487039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.487039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.488216] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.588481] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ee2a8ee-106e-4497-b520-f9bee7fda54a [ 657.588481] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.588481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.588481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.588481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.589610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.589610] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ee2a8ee-106e-4497-b520-f9bee7fda54a already deleted. [ 657.589610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ee2a8ee-106e-4497-b520-f9bee7fda54a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.692398] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c07b5469-0677-46ea-bbd6-7fb5c2037b86 [ 657.692398] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.692398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.692398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.692802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.692802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.692802] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c07b5469-0677-46ea-bbd6-7fb5c2037b86 already deleted. [ 657.692902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c07b5469-0677-46ea-bbd6-7fb5c2037b86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.916714] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.991791] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.992172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.992844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.993238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.994060] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.994244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.994336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.994589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.994718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.994825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.995008] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.997826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.997948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.998283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.998577] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.999647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.999755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.000014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.000190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.000278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.000347] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.051341] env[65630]: INFO networking_nsxv3.common.synchronization [req-6c901bcf-179c-45d6-af6f-686a02951b44 req-7f4ef279-5894-4fad-bc8c-892a4dd155e9 tempest-ServersWithSpecificFlavorTestJSON-478407304 tempest-ServersWithSpecificFlavorTestJSON-478407304-project-member] Enqueued Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_members [ 658.054871] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_members [ 658.056175] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.056175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.056175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.056577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.056892] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.057042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.057124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.057333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.057429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.057526] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.419734] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.504661] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcabb3c1-63c7-4e6e-99e0-7cb17896f367: rpc.has_security_group_logging(os_id): False [ 658.508866] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.509121] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.509225] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.509679] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.509810] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.509987] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.510125] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.510354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.510488] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.510693] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.510798] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.510897] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.511041] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.511160] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.511260] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.511389] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.521044] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d in Status: SUCCESS [ 658.521230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.537613] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.537784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.537856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.538567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.538567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.538733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.538804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.538804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.538987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.539127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.540200] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.540200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.540200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.540200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.540200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.540200] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.540200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.540200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.540575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.540575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.540575] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 is going to be created. [ 658.559995] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.559995] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.560264] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.560571] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-15" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.561015] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-b682f53a-f55b-43a8-b460-124f0f617983 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.561340] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.561580] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.563195] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.563195] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b682f53a-f55b-43a8-b460-124f0f617983',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.564478] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.564767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.564767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.564893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.564972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.565286] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.565389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.565389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.566255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.566255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.566255] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d already deleted. [ 658.566255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.614036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.614209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.614262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.615164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.615335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.632710] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 in Status: IN_PROGRESS for 2s [ 658.925053] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.925263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.925359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.925665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.925778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.925910] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 is going to be updated. [ 658.975880] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.975880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.975880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.975880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.975880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.988064] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: IN_PROGRESS for 2s [ 659.066112] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.066386] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.066506] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.066803] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.067610] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.067610] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port b682f53a-f55b-43a8-b460-124f0f617983 not found, creating... [ 659.067610] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.067610] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.067610] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.067855] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.067968] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.068270] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.068423] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.068536] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.068730] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.068885] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.069982] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: b682f53a-f55b-43a8-b460-124f0f617983 is going to be created. [ 659.108581] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.108919] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.109427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.109427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.109606] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.109892] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.786088] env[65630]: INFO networking_nsxv3.common.synchronization [req-121ea3b5-74f2-49e1-8614-ae9277a75a17 req-698a1fb3-30f2-45bf-b9a7-ab9eb55076d7 tempest-ServersAdminNegativeTestJSON-2028070641 tempest-ServersAdminNegativeTestJSON-2028070641-project-member] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 659.786792] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 659.787294] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.787515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.787567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.787773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.788011] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.788149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.788241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.788464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.788568] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.788689] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.837109] env[65630]: INFO networking_nsxv3.common.synchronization [req-6c901bcf-179c-45d6-af6f-686a02951b44 req-70f36df8-c16c-413f-99c8-e7c0c5273164 service nova] Enqueued Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_rules [ 659.837302] env[65630]: INFO networking_nsxv3.common.synchronization [req-6c901bcf-179c-45d6-af6f-686a02951b44 req-70f36df8-c16c-413f-99c8-e7c0c5273164 service nova] Enqueued Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_members [ 659.837432] env[65630]: INFO networking_nsxv3.common.synchronization [req-6c901bcf-179c-45d6-af6f-686a02951b44 req-70f36df8-c16c-413f-99c8-e7c0c5273164 service nova] Enqueued Resource ID: b682f53a-f55b-43a8-b460-124f0f617983 with Priority: HIGHEST for action port [ 659.837913] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_rules [ 659.838262] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_members [ 659.838429] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b682f53a-f55b-43a8-b460-124f0f617983 with Priority: HIGHEST for action port [ 659.839198] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.839198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.839198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.839198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.839198] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.840213] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.840390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.840458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.840688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.840843] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.840977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.841085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.841296] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.841447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.841624] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.842933] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b682f53a-f55b-43a8-b460-124f0f617983 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.843247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.843247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.843362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.843451] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b682f53a-f55b-43a8-b460-124f0f617983',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.932152] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9fb5df4c-9134-47f7-8345-213dc51afc7b None None] Enqueued Resource ID: 19b810be-5b64-459f-91b9-2896d2b92246 with Priority: HIGHEST for action port [ 659.932770] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19b810be-5b64-459f-91b9-2896d2b92246 with Priority: HIGHEST for action port [ 659.933618] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-19b810be-5b64-459f-91b9-2896d2b92246 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.933618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19b810be-5b64-459f-91b9-2896d2b92246" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.933618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19b810be-5b64-459f-91b9-2896d2b92246" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.934229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19b810be-5b64-459f-91b9-2896d2b92246" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.934371] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19b810be-5b64-459f-91b9-2896d2b92246',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.173751] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.173751] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.173751] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.173751] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.173751] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.173751] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.173751] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.174082] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.174082] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.174979] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.174979] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.174979] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.174979] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.174979] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.174979] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.174979] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.195409] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.195409] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.195549] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.195696] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.196018] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-9cfb2bb0-1829-457e-bf18-f914f18d9640 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.196191] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.196305] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.196687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.196822] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfb2bb0-1829-457e-bf18-f914f18d9640',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.291391] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.346254] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.346254] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.346254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.353434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b682f53a-f55b-43a8-b460-124f0f617983 with status ACTIVE [ 660.353434] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.353434] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.353434] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.353434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.353434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b682f53a-f55b-43a8-b460-124f0f617983 is going to be updated. [ 660.376846] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.377064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.377203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.377471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.377603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.377799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b682f53a-f55b-43a8-b460-124f0f617983" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.439770] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19b810be-5b64-459f-91b9-2896d2b92246 [ 660.439770] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.439770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.439770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.440695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.440815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.440926] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19b810be-5b64-459f-91b9-2896d2b92246 already deleted. [ 660.441059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19b810be-5b64-459f-91b9-2896d2b92246" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.543853] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5e60c718-1202-4039-abad-7e3b735a29f8 None None] Enqueued Resource ID: c58a3594-aeb6-4821-9f87-dca53856547c with Priority: HIGHEST for action port [ 660.548163] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c58a3594-aeb6-4821-9f87-dca53856547c with Priority: HIGHEST for action port [ 660.548163] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c58a3594-aeb6-4821-9f87-dca53856547c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.548163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c58a3594-aeb6-4821-9f87-dca53856547c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.548163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c58a3594-aeb6-4821-9f87-dca53856547c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.548163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c58a3594-aeb6-4821-9f87-dca53856547c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.548163] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c58a3594-aeb6-4821-9f87-dca53856547c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.648297] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 in Status: SUCCESS [ 660.648498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.699120] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.699363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.699547] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.699870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.700047] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.700457] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 9cfb2bb0-1829-457e-bf18-f914f18d9640 not found, creating... [ 660.700532] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.700634] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.700745] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.700965] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.701128] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.701411] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.701523] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.701634] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.702098] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.702098] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.703893] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 9cfb2bb0-1829-457e-bf18-f914f18d9640 is going to be created. [ 660.727527] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.727764] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.728254] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.728568] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.728801] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.729868] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.794645] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.847305] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.000638] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: SUCCESS [ 661.001047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.001420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.001745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.002067] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.002318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.002385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.002675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.002722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.002811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.002930] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.051027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c58a3594-aeb6-4821-9f87-dca53856547c [ 661.051362] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.051529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.051702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.051871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.051926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.052111] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c58a3594-aeb6-4821-9f87-dca53856547c already deleted. [ 661.052237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c58a3594-aeb6-4821-9f87-dca53856547c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.299214] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.299670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.299758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.299891] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be updated. [ 661.333134] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.333326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.333398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.333635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.333863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.349827] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.350062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.350152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.350455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.350552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.350677] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d is going to be created. [ 661.353177] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: IN_PROGRESS for 2s [ 661.381699] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.382573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.382573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.382573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.382573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.394516] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d in Status: UNINITIALIZED for 2s [ 661.489466] env[65630]: INFO networking_nsxv3.common.synchronization [req-121ea3b5-74f2-49e1-8614-ae9277a75a17 req-b32d54a1-486b-4a3d-af21-486e519678b2 service nova] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_rules [ 661.489687] env[65630]: INFO networking_nsxv3.common.synchronization [req-121ea3b5-74f2-49e1-8614-ae9277a75a17 req-b32d54a1-486b-4a3d-af21-486e519678b2 service nova] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 661.489944] env[65630]: INFO networking_nsxv3.common.synchronization [req-121ea3b5-74f2-49e1-8614-ae9277a75a17 req-b32d54a1-486b-4a3d-af21-486e519678b2 service nova] Enqueued Resource ID: 9cfb2bb0-1829-457e-bf18-f914f18d9640 with Priority: HIGHEST for action port [ 661.490428] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_rules [ 661.490570] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 661.490670] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cfb2bb0-1829-457e-bf18-f914f18d9640 with Priority: HIGHEST for action port [ 661.490936] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.491471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.491562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.491754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.491838] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.492817] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.492970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.493234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cfb2bb0-1829-457e-bf18-f914f18d9640 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.493348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.493401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.493551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.493628] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfb2bb0-1829-457e-bf18-f914f18d9640',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.505601] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.505601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.505601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.509608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.509608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.509608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.509608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.509608] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.999479] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.999479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.002021] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cfb2bb0-1829-457e-bf18-f914f18d9640 with status ACTIVE [ 662.002171] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.003102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.003102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.003102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.003102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.003102] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.003102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.003102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.003341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.003341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.004465] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.004465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.004465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.004465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.004465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.004465] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cfb2bb0-1829-457e-bf18-f914f18d9640 is going to be updated. [ 662.010327] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f9d43bc-6007-4e6a-81c6-321db263b170: rpc.has_security_group_logging(os_id): False [ 662.031034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.031034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.031034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.031034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.033218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.033218] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.033218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.033218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.033218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.033218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.033218] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 is going to be updated. [ 662.034363] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.034513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.034586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.034752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.034872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.035042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cfb2bb0-1829-457e-bf18-f914f18d9640" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.108227] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.108227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.108227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.108227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.108227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.127403] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: IN_PROGRESS for 2s [ 662.136147] env[65630]: INFO networking_nsxv3.common.synchronization [req-287f092d-9c15-4161-98b0-4c1cf04f93c9 req-8af6e2f0-c816-406f-994f-64ab1e45bdb2 tempest-InstanceActionsNegativeTestJSON-1796371831 tempest-InstanceActionsNegativeTestJSON-1796371831-project-member] Enqueued Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_members [ 662.136702] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGHEST for action security_group_members [ 662.137014] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.137229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.137229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.137397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.137546] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.137639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.137701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.137841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.138017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.138115] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.640080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.640331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.640419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.640757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.640896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.641238] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.641418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.641468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.641655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.641754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.641883] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d21511b-a9da-4941-a727-0448d9306e2b is going to be updated. [ 662.696429] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.696694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.696758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.696985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.697130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.718721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d21511b-a9da-4941-a727-0448d9306e2b in Status: IN_PROGRESS for 2s [ 663.368570] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: SUCCESS [ 663.372209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.372209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.372209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.372209] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.372209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.372209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.372209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.373165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.373331] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.412024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d in Status: SUCCESS [ 663.412024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.412024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.412024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.412024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.412024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.412024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.412586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.412586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.412586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.412586] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.594389] env[65630]: INFO networking_nsxv3.common.synchronization [req-84f6f1a7-25f1-414f-897d-c62aa55d17b6 req-1ffaba00-1b82-4249-a5b3-50e48f511ef3 tempest-InstanceActionsTestJSON-690180015 tempest-InstanceActionsTestJSON-690180015-project-member] Enqueued Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_members [ 663.595459] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGHEST for action security_group_members [ 663.595848] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.595984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.596073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.596295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.596852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.597009] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.597139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.597331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.597431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.597530] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.876085] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.919196] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.101211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.101211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.101378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.101536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.101850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.101850] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.102068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.102068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.102155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.102199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.102282] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f is going to be updated. [ 664.140425] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.140694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.140694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.141630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.141630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.144669] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: SUCCESS [ 664.145069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.225153] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f in Status: IN_PROGRESS for 2s [ 664.380740] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.423080] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d: rpc.has_security_group_logging(os_id): False [ 664.442755] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.443120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.443627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.443627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.443627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.443949] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.444028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.444079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.444234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.444323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.444405] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d is going to be created. [ 664.514094] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.514094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.514094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.514094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.514094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.537808] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d in Status: IN_PROGRESS for 2s [ 664.728028] env[65630]: INFO networking_nsxv3.common.synchronization [req-a9b59133-d3ab-4092-80c4-cc019c7498e9 req-1489179e-71e3-42ff-b3c8-0c34dd5c223c tempest-ServerDiagnosticsNegativeTest-1476230730 tempest-ServerDiagnosticsNegativeTest-1476230730-project-member] Enqueued Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_members [ 664.728887] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_members [ 664.728887] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.729142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.729142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.729345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.729518] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.729651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.729742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.729974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.730206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.730261] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.734925] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d21511b-a9da-4941-a727-0448d9306e2b in Status: SUCCESS [ 664.734998] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d21511b-a9da-4941-a727-0448d9306e2b deletion is rescheduled due to dependency. [ 664.735497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.885027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.885318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.885318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.886382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.886382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.886382] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be updated. [ 664.924119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.924369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.924369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.924643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.924832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.937662] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: IN_PROGRESS for 2s [ 665.105021] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.105271] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.105382] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.105815] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.105925] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.106322] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.106322] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.106480] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.106629] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.106783] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.106909] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.107033] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.107131] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.107257] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.107366] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.107509] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.134468] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.134468] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.134468] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.134468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.134468] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.134468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.134468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.134468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.134468] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f57be695-0adb-4fb8-bbca-fc3989d3f6c8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.233352] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.233510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.233580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.233802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.233908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.234104] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.234205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.234268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.234421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.234496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.234579] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 already deleted. [ 665.235015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.444789] env[65630]: INFO networking_nsxv3.common.synchronization [None req-476ac1e6-4fdd-4d0c-87e6-c5ba87001c3c None None] Enqueued Resource ID: 1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc with Priority: HIGHEST for action port [ 665.445135] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc with Priority: HIGHEST for action port [ 665.445701] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.445842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.445884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.446192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.446312] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.637914] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.638191] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.638320] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.638593] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.638736] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.638885] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port f57be695-0adb-4fb8-bbca-fc3989d3f6c8 not found, creating... [ 665.639181] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.639316] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.639428] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.639644] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.639775] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.640102] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.640272] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.640387] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.640594] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.640723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.640858] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: f57be695-0adb-4fb8-bbca-fc3989d3f6c8 is going to be created. [ 665.666427] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.666427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.666427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.666427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.666427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.666427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.950713] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc [ 665.950713] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.950713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.950713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.950713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.950713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.950713] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc already deleted. [ 665.950713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aaafbfd-54b0-4d83-90ba-3a33a0dea9fc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.237125] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f in Status: SUCCESS [ 666.237333] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f deletion is rescheduled due to dependency. [ 666.237451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.487452] env[65630]: INFO networking_nsxv3.common.synchronization [req-a9b59133-d3ab-4092-80c4-cc019c7498e9 req-1149ad6c-c9cb-4655-8f56-9d0d4f04145a service nova] Enqueued Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_rules [ 666.487804] env[65630]: INFO networking_nsxv3.common.synchronization [req-a9b59133-d3ab-4092-80c4-cc019c7498e9 req-1149ad6c-c9cb-4655-8f56-9d0d4f04145a service nova] Enqueued Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_members [ 666.487904] env[65630]: INFO networking_nsxv3.common.synchronization [req-a9b59133-d3ab-4092-80c4-cc019c7498e9 req-1149ad6c-c9cb-4655-8f56-9d0d4f04145a service nova] Enqueued Resource ID: f57be695-0adb-4fb8-bbca-fc3989d3f6c8 with Priority: HIGHEST for action port [ 666.490438] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_rules [ 666.490438] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_members [ 666.490438] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f57be695-0adb-4fb8-bbca-fc3989d3f6c8 with Priority: HIGHEST for action port [ 666.490438] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.491231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.491340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.491661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.491749] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.493573] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.493798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.493882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.494462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.494650] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.494756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.494818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.494974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.495089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.495178] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.496886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.497030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.497374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.497374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.497474] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f57be695-0adb-4fb8-bbca-fc3989d3f6c8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.555563] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d in Status: SUCCESS [ 666.555563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.761512] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-fa5c4a0f-2f0d-4b0c-856e-2427140c53e2 tempest-ListServersNegativeTestJSON-1633369316 tempest-ListServersNegativeTestJSON-1633369316-project-member] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 666.761990] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 666.762554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.762687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.762754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.763063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.763233] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.763341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.763404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.763574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.763661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.763750] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.950721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: SUCCESS [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.950721] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.950721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.951418] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.997574] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.001433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.001612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.001838] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f57be695-0adb-4fb8-bbca-fc3989d3f6c8 with status ACTIVE [ 667.002317] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.002317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.002317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.002484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.005663] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.005663] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.005663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.005663] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f57be695-0adb-4fb8-bbca-fc3989d3f6c8 is going to be updated. [ 667.029966] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.029966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.029966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.030357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.030395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.030954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f57be695-0adb-4fb8-bbca-fc3989d3f6c8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.267254] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.267421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.267421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.268228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.268228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.268228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.268228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.268228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.268431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.268431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.268653] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be already deleted. [ 667.268727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.313437] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.313437] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.313437] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.313743] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.314244] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.315123] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.315733] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.315733] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.315910] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.316029] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.316171] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.317085] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.317085] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.317169] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.317237] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.317373] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.349711] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.349711] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 667.349711] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.349711] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.350441] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-bf0efa7b-9287-481c-a771-f9c1a57cad2d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.350441] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.350441] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.350741] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.351016] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0efa7b-9287-481c-a771-f9c1a57cad2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.458388] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.458612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.458853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.458952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.459358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.459358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.459450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.459584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.459784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.459784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.459972] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.460373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.460373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.460448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.460578] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.460707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.460765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.460919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.461025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.463303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.465075] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.501793] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.854222] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.854222] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.854343] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.854675] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.854890] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.855136] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port bf0efa7b-9287-481c-a771-f9c1a57cad2d not found, creating... [ 667.855477] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.855700] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.855878] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.856199] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.856396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.856794] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.857034] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.857184] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.857472] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.857672] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.857857] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: bf0efa7b-9287-481c-a771-f9c1a57cad2d is going to be created. [ 667.881160] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.881435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.881561] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.881853] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.882093] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.882354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.967498] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fceb03c-a6a6-44ca-a458-09915f16c26b: rpc.has_security_group_logging(os_id): False [ 667.995337] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.995528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.995628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.995770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.995867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.996079] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.996185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.996264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.996435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.996535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.996717] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.996813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.996876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.997035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.997114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.997716] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.997716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.997716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.997716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.997716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.997939] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be updated. [ 668.005059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.006075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.006075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.006075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.006075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.006075] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 is going to be created. [ 668.053026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.053273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.053273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.053491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.053683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.072232] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 in Status: UNINITIALIZED for 2s [ 668.090506] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.091194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.091194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.091194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.091194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.116055] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: IN_PROGRESS for 2s [ 668.119346] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a653a4ec-a6e8-4985-9a1a-1e7c89bea4f7 None None] Enqueued Resource ID: 4181fec9-deca-4935-b777-29c4b98a7c5d with Priority: HIGHEST for action port [ 668.120668] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4181fec9-deca-4935-b777-29c4b98a7c5d with Priority: HIGHEST for action port [ 668.121358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4181fec9-deca-4935-b777-29c4b98a7c5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.121541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4181fec9-deca-4935-b777-29c4b98a7c5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.121541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4181fec9-deca-4935-b777-29c4b98a7c5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.121790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4181fec9-deca-4935-b777-29c4b98a7c5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.122023] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4181fec9-deca-4935-b777-29c4b98a7c5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.625442] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4181fec9-deca-4935-b777-29c4b98a7c5d [ 668.625442] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.625442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.625442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.626256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.626256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.626256] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4181fec9-deca-4935-b777-29c4b98a7c5d already deleted. [ 668.626256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4181fec9-deca-4935-b777-29c4b98a7c5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.714878] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-fac0e201-61de-445b-845a-f41198e8e0cd service nova] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_rules [ 668.714878] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-fac0e201-61de-445b-845a-f41198e8e0cd service nova] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 668.715040] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-fac0e201-61de-445b-845a-f41198e8e0cd service nova] Enqueued Resource ID: bf0efa7b-9287-481c-a771-f9c1a57cad2d with Priority: HIGHEST for action port [ 668.715474] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_rules [ 668.715633] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 668.716216] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0efa7b-9287-481c-a771-f9c1a57cad2d with Priority: HIGHEST for action port [ 668.716583] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.716789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.716897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.717282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.717402] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.718725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.718849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.718918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.719135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.719290] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.719913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.720070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.720696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.720696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.720696] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.721993] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0efa7b-9287-481c-a771-f9c1a57cad2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.722221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.722319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.722518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.723689] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0efa7b-9287-481c-a771-f9c1a57cad2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.223690] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.230262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.230262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.230262] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf0efa7b-9287-481c-a771-f9c1a57cad2d with status ACTIVE [ 669.230262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.230262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.230262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.230262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.230262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.230827] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.230827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.230827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.231016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.231016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.231542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.231542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.231542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.232138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.232138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.232138] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf0efa7b-9287-481c-a771-f9c1a57cad2d is going to be updated. [ 669.265049] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.265330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.265330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.265505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.265612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.265778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0efa7b-9287-481c-a771-f9c1a57cad2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.578245] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-820635b4-27be-4911-a154-e2953a45e130 tempest-ListServersNegativeTestJSON-1633369316 tempest-ListServersNegativeTestJSON-1633369316-project-member] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 669.579659] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 669.580543] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.580702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.728766] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.088403] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 in Status: SUCCESS [ 670.088707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.088980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.089442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.094835] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.095228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.095351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.095685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.095808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.095943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.096316] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.147473] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: SUCCESS [ 670.147786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.231747] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.232078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.232078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.232273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.232370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.232474] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be created. [ 670.262594] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.262852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.262852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.263044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.263219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.277713] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: UNINITIALIZED for 2s [ 670.599746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.599969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.599969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.600340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.600477] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.601899] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.601899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.602421] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.602421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.602421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.602741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.602741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.602859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.602944] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.813852] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.814367] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.814575] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.814863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.815321] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.815537] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.815756] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.815947] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.816643] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.816643] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.816778] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.816778] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.816988] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.817088] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.817225] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.817464] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.839819] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.840137] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.840363] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.840499] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.840833] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-08ae25fc-1376-4cd0-a72f-b147bb433595 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.841409] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.841409] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.841703] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.841776] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ae25fc-1376-4cd0-a72f-b147bb433595',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.105248] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6e4b9ba-b619-44fb-9494-9deb59f438b6: rpc.has_security_group_logging(os_id): False [ 671.127815] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.128076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.128184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.128415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.128521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.128698] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.128798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.128859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.129023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.129104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.129289] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.129381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.129446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.129585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.129660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.129851] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.129946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.130017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.130447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.130537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.130660] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 is going to be created. [ 671.163780] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6d1cfce9-5d7f-4832-aa30-c0a481ac5fc7 None None] Enqueued Resource ID: cbbe0e9f-8e77-462d-9946-cae0869bcb6c with Priority: HIGHEST for action port [ 671.164547] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbbe0e9f-8e77-462d-9946-cae0869bcb6c with Priority: HIGHEST for action port [ 671.164928] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbbe0e9f-8e77-462d-9946-cae0869bcb6c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.165118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbbe0e9f-8e77-462d-9946-cae0869bcb6c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.165169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbbe0e9f-8e77-462d-9946-cae0869bcb6c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.165437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbbe0e9f-8e77-462d-9946-cae0869bcb6c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.165531] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbbe0e9f-8e77-462d-9946-cae0869bcb6c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.195025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.195595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.195595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.195595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.195809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.213795] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 in Status: IN_PROGRESS for 2s [ 671.266157] env[65630]: INFO networking_nsxv3.common.synchronization [None req-458430f7-73c5-4472-b162-a2dd8c8adb04 None None] Enqueued Resource ID: 707e9758-23d4-4f74-a615-883cfa751217 with Priority: HIGHEST for action port [ 671.267778] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 707e9758-23d4-4f74-a615-883cfa751217 with Priority: HIGHEST for action port [ 671.268253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-707e9758-23d4-4f74-a615-883cfa751217 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.268500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-707e9758-23d4-4f74-a615-883cfa751217" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.268674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-707e9758-23d4-4f74-a615-883cfa751217" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.269322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-707e9758-23d4-4f74-a615-883cfa751217" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.269440] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('707e9758-23d4-4f74-a615-883cfa751217',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.344627] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.344874] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.344983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.345294] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.345446] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.345674] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 08ae25fc-1376-4cd0-a72f-b147bb433595 not found, creating... [ 671.345886] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.346037] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.346155] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.346438] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.346612] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.347030] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.347148] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.347190] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.347391] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.347536] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.347673] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 08ae25fc-1376-4cd0-a72f-b147bb433595 is going to be created. [ 671.387590] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.387782] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.387973] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.388460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.388738] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.389018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.668098] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbbe0e9f-8e77-462d-9946-cae0869bcb6c [ 671.668319] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.668452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.668527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.668723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.668815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.668915] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbbe0e9f-8e77-462d-9946-cae0869bcb6c already deleted. [ 671.668998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbbe0e9f-8e77-462d-9946-cae0869bcb6c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.774875] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 707e9758-23d4-4f74-a615-883cfa751217 [ 671.775186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.775354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.775435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.775668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.775769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.775913] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:707e9758-23d4-4f74-a615-883cfa751217 already deleted. [ 671.776070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-707e9758-23d4-4f74-a615-883cfa751217" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.145109] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-394b2e9a-b689-45be-8226-212d726235d7 service nova] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_rules [ 672.145557] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-394b2e9a-b689-45be-8226-212d726235d7 service nova] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 672.145557] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-394b2e9a-b689-45be-8226-212d726235d7 service nova] Enqueued Resource ID: 08ae25fc-1376-4cd0-a72f-b147bb433595 with Priority: HIGHEST for action port [ 672.146025] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_rules [ 672.146164] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 672.146257] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ae25fc-1376-4cd0-a72f-b147bb433595 with Priority: HIGHEST for action port [ 672.146528] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.146626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.146810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.147262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.147520] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-08ae25fc-1376-4cd0-a72f-b147bb433595 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.147661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.147748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.147988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.148128] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ae25fc-1376-4cd0-a72f-b147bb433595',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.291248] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: UNINITIALIZED for 4s [ 672.470164] env[65630]: INFO networking_nsxv3.common.synchronization [req-bb58589a-e485-4998-ae6b-0318ef0353e8 req-f6e7a1be-4b45-4126-82f4-c97fac488001 tempest-ServerDiagnosticsTest-1694489187 tempest-ServerDiagnosticsTest-1694489187-project-member] Enqueued Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_members [ 672.470445] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGHEST for action security_group_members [ 672.470749] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.471280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.471280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.471457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.471644] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.473811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.473811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.473811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.473811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.473811] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.654723] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08ae25fc-1376-4cd0-a72f-b147bb433595 with status ACTIVE [ 672.654723] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.654723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.654723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.654723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.654723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.654975] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.654975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.655075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.655203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.655282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.655455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.655550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.655609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.655747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.655821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.655903] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08ae25fc-1376-4cd0-a72f-b147bb433595 is going to be updated. [ 672.683734] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.684401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.685079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.685305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.686063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.686063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08ae25fc-1376-4cd0-a72f-b147bb433595" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.975266] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.975458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.975514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.975727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.975822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.976076] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.976194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.976194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.976464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.976464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.976574] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f85ab7-23ea-4874-b442-58c60cf9adee is going to be updated. [ 673.007383] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.007572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.007572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.007794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.007923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.019675] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f85ab7-23ea-4874-b442-58c60cf9adee in Status: IN_PROGRESS for 2s [ 673.107118] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-ab81192e-8421-45a0-87ee-6435392e5b79 tempest-ListServersNegativeTestJSON-1633369316 tempest-ListServersNegativeTestJSON-1633369316-project-member] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 673.107883] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 673.107883] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.107883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.229878] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 in Status: SUCCESS [ 673.230212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.298962] env[65630]: INFO networking_nsxv3.common.synchronization [req-23e80731-6958-41c9-9671-31118e6fbfb9 req-43aea6ec-6fbe-4be8-8b93-7d09aae1cd8e tempest-VolumesAdminNegativeTest-1141332750 tempest-VolumesAdminNegativeTest-1141332750-project-member] Enqueued Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_members [ 673.299651] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGHEST for action security_group_members [ 673.299991] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.303042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.303042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.303042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.303042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.303042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.303042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.303042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.303042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.303042] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.543427] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.543427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.543427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.543427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.543427] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.543427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.544030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.544286] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.544434] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.544635] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.544740] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.544843] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.544976] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.545057] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.545154] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.545290] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.571734] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.571734] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 673.571734] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.571734] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-754" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.571734] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-89d65a9a-4190-465e-8d08-dadfb54880b4 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.571975] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.571975] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.572339] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.572493] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d65a9a-4190-465e-8d08-dadfb54880b4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.609545] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a858dfa0-65d9-4501-a62a-cd802dad2b91 None None] Enqueued Resource ID: f97fb9e0-cf09-4aac-afed-b885aa5a5dd7 with Priority: HIGHEST for action port [ 673.610686] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f97fb9e0-cf09-4aac-afed-b885aa5a5dd7 with Priority: HIGHEST for action port [ 673.611438] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f97fb9e0-cf09-4aac-afed-b885aa5a5dd7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.611929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f97fb9e0-cf09-4aac-afed-b885aa5a5dd7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.611929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f97fb9e0-cf09-4aac-afed-b885aa5a5dd7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.612126] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f97fb9e0-cf09-4aac-afed-b885aa5a5dd7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.612259] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f97fb9e0-cf09-4aac-afed-b885aa5a5dd7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.791494] env[65630]: INFO networking_nsxv3.common.synchronization [None req-30ad397e-2b7c-47df-9720-aa268a5a53c4 None None] Enqueued Resource ID: 56646d2f-15be-4744-848a-35d7fafac45e with Priority: HIGHEST for action port [ 673.792158] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56646d2f-15be-4744-848a-35d7fafac45e with Priority: HIGHEST for action port [ 673.792544] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-56646d2f-15be-4744-848a-35d7fafac45e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.792675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56646d2f-15be-4744-848a-35d7fafac45e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.792753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56646d2f-15be-4744-848a-35d7fafac45e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.792999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56646d2f-15be-4744-848a-35d7fafac45e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.793495] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56646d2f-15be-4744-848a-35d7fafac45e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.807019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.807209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.807283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.807565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.807696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.807945] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.808130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.808220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.808450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.808745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.808745] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 is going to be updated. [ 673.848615] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.848934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.849079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.849567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.849715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.864479] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 in Status: IN_PROGRESS for 2s [ 674.077065] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.077065] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.077065] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.077389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.077543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.077758] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 89d65a9a-4190-465e-8d08-dadfb54880b4 not found, creating... [ 674.078257] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.078472] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.078472] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.078697] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.078854] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.079279] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.079381] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.079699] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.079938] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.080312] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.080611] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 89d65a9a-4190-465e-8d08-dadfb54880b4 is going to be created. [ 674.109030] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.109030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.109030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.109030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.109030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.115542] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f97fb9e0-cf09-4aac-afed-b885aa5a5dd7 [ 674.115542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.115787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.115787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.116952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.117132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.117249] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f97fb9e0-cf09-4aac-afed-b885aa5a5dd7 already deleted. [ 674.117342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f97fb9e0-cf09-4aac-afed-b885aa5a5dd7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.295484] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56646d2f-15be-4744-848a-35d7fafac45e [ 674.295825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.295989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.295989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.296308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.296463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.296611] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56646d2f-15be-4744-848a-35d7fafac45e already deleted. [ 674.296759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56646d2f-15be-4744-848a-35d7fafac45e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.305551] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 674.305692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.305869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.306138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.306350] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.306549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.306549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.306714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.306803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.306893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.306993] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.307915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.308117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.308286] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.308385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.308443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.308585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.308662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.308755] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.810886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.811080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.811220] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.883704] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-2b9bec28-2f12-4bf8-ad31-a0c95ad98f31 service nova] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_rules [ 674.883874] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-2b9bec28-2f12-4bf8-ad31-a0c95ad98f31 service nova] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 674.884014] env[65630]: INFO networking_nsxv3.common.synchronization [req-fb045dad-70e8-419f-914f-d6a8bc4672b8 req-2b9bec28-2f12-4bf8-ad31-a0c95ad98f31 service nova] Enqueued Resource ID: 89d65a9a-4190-465e-8d08-dadfb54880b4 with Priority: HIGHEST for action port [ 674.884249] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_rules [ 674.884383] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 674.884485] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89d65a9a-4190-465e-8d08-dadfb54880b4 with Priority: HIGHEST for action port [ 674.885375] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.885375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.885551] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.885608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.885777] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-89d65a9a-4190-465e-8d08-dadfb54880b4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.885881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.885932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.886191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.886234] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d65a9a-4190-465e-8d08-dadfb54880b4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.974896] env[65630]: INFO networking_nsxv3.common.synchronization [req-7cb63a8c-b90b-4643-b7f8-ebff2223a7da req-622686cd-4eb2-45c2-9a54-e80c499e09aa tempest-ServersTestBootFromVolume-671027587 tempest-ServersTestBootFromVolume-671027587-project-member] Enqueued Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_members [ 674.975481] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_members [ 674.976971] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.977239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.977363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.977711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.978200] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.978617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.978745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.979201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.979356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.979495] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.031343] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f85ab7-23ea-4874-b442-58c60cf9adee in Status: SUCCESS [ 675.031671] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f85ab7-23ea-4874-b442-58c60cf9adee deletion is rescheduled due to dependency. [ 675.031859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.235674] env[65630]: INFO networking_nsxv3.common.synchronization [req-f39a6d53-1c66-4a9e-8593-c7d608fa66ae req-b248d513-787b-4f00-a799-0adbf51280ca tempest-TenantUsagesTestJSON-717349194 tempest-TenantUsagesTestJSON-717349194-project-member] Enqueued Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_members [ 675.236243] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGHEST for action security_group_members [ 675.237339] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.237487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.237582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.237858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.238063] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.238219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.238284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.238415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.238499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.238591] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.314316] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.388096] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89d65a9a-4190-465e-8d08-dadfb54880b4 with status ACTIVE [ 675.388286] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.388803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.388803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.388963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.388963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.389158] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.389326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.389367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.389524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.389632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.389834] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.389954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.390264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.390481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.390583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.391189] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89d65a9a-4190-465e-8d08-dadfb54880b4 is going to be updated. [ 675.413608] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-13 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.413608] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-13" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.413608] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-13" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.414111] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-13" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.414444] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.414638] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.414776] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.415138] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.415354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.415614] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.415726] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.415830] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.415931] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.416053] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.416151] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.416278] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.418608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.418856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.418856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.420298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.420298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.420298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89d65a9a-4190-465e-8d08-dadfb54880b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.442630] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.442987] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.443166] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.443407] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-13" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.443773] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.443993] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.444177] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.444594] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.444783] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeef8056-d4bb-47a1-b4a2-8b1e02f43839',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.483491] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.483710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.483888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.484188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.484339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.484584] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.484745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.484945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.485279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.485432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.485572] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d already deleted. [ 675.485755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.742568] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.742902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.742902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.743143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.743194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.743457] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.743525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.743580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.743764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.743764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.743856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4db90ff6-65fb-428b-b489-30d9d407642e is going to be updated. [ 675.778710] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.779022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.779022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.779289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.779466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.790900] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4db90ff6-65fb-428b-b489-30d9d407642e in Status: IN_PROGRESS for 2s [ 675.816617] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.816841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.816841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.817070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.817160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.817286] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 675.865223] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.865425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.865555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.865688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.865830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.877333] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 in Status: SUCCESS [ 675.877552] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 deletion is rescheduled due to dependency. [ 675.877694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.878491] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 675.947620] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.947854] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.947975] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.948496] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.948691] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.948856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port eeef8056-d4bb-47a1-b4a2-8b1e02f43839 not found, creating... [ 675.949184] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.949355] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.949465] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.949695] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.949829] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.950199] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.950365] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.950459] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.950666] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.950791] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.950956] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: eeef8056-d4bb-47a1-b4a2-8b1e02f43839 is going to be created. [ 675.978242] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.978242] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.978242] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.978242] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.978242] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.978242] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.787061] env[65630]: INFO networking_nsxv3.common.synchronization [req-7cb63a8c-b90b-4643-b7f8-ebff2223a7da req-5d1b2dc7-29d8-4314-8aae-98e4e4e2745d service nova] Enqueued Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_rules [ 676.787061] env[65630]: INFO networking_nsxv3.common.synchronization [req-7cb63a8c-b90b-4643-b7f8-ebff2223a7da req-5d1b2dc7-29d8-4314-8aae-98e4e4e2745d service nova] Enqueued Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_members [ 676.787061] env[65630]: INFO networking_nsxv3.common.synchronization [req-7cb63a8c-b90b-4643-b7f8-ebff2223a7da req-5d1b2dc7-29d8-4314-8aae-98e4e4e2745d service nova] Enqueued Resource ID: eeef8056-d4bb-47a1-b4a2-8b1e02f43839 with Priority: HIGHEST for action port [ 676.790067] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_rules [ 676.790067] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_members [ 676.790067] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeef8056-d4bb-47a1-b4a2-8b1e02f43839 with Priority: HIGHEST for action port [ 676.790067] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.790067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.790067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.790067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.790067] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.790461] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.790630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.790630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.790762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.790937] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.793322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.793322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.794072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.794072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.794072] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.794881] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.794994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.795081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.796045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.796045] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeef8056-d4bb-47a1-b4a2-8b1e02f43839',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.230808] env[65630]: INFO networking_nsxv3.common.synchronization [req-ea42c067-c72f-456e-9263-dd34f5aaca40 req-673f2b9a-d2e0-407e-ad11-c4d6517429d4 tempest-SecurityGroupRulesTestJSON-1886688061 tempest-SecurityGroupRulesTestJSON-1886688061-project-member] Enqueued Resource ID: 73de1148-eb92-402c-aae1-da0b413fdca4 with Priority: HIGHEST for action security_group_rules [ 677.232319] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73de1148-eb92-402c-aae1-da0b413fdca4 with Priority: HIGHEST for action security_group_rules [ 677.234403] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73de1148-eb92-402c-aae1-da0b413fdca4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.234403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73de1148-eb92-402c-aae1-da0b413fdca4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.234403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73de1148-eb92-402c-aae1-da0b413fdca4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.234403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73de1148-eb92-402c-aae1-da0b413fdca4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.234403] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73de1148-eb92-402c-aae1-da0b413fdca4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.298704] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.298704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.298704] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.299662] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeef8056-d4bb-47a1-b4a2-8b1e02f43839 with status ACTIVE [ 677.299932] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.300123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.300232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.300492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.300631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.300869] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.304528] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.304528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.304528] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeef8056-d4bb-47a1-b4a2-8b1e02f43839 is going to be updated. [ 677.332620] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.332620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.332620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.332620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.332620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.332620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeef8056-d4bb-47a1-b4a2-8b1e02f43839" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.758195] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.758195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.758195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.758195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.758195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.759072] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73de1148-eb92-402c-aae1-da0b413fdca4 already deleted. [ 677.759248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73de1148-eb92-402c-aae1-da0b413fdca4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.802867] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4db90ff6-65fb-428b-b489-30d9d407642e in Status: SUCCESS [ 677.802867] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4db90ff6-65fb-428b-b489-30d9d407642e deletion is rescheduled due to dependency. [ 677.802867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.807607] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.891128] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 677.891388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.891969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.892214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.892576] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.892576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.892576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.892799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.892799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.892931] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.291858] env[65630]: INFO networking_nsxv3.common.synchronization [None req-ac3d9a0f-bb22-403a-87bc-f2234af28067 tempest-ServersTestFqdnHostnames-1506153026 tempest-ServersTestFqdnHostnames-1506153026-project-member] Enqueued Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_rules [ 678.292421] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_rules [ 678.292725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8db9dba-41a6-4390-8a03-e9d1a073b831 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.292990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.293477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.295658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.296324] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.309253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.309399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.309484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.309702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.309782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.309881] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d is going to be created. [ 678.342373] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.342373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.342373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.342623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.342707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.369503] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d in Status: UNINITIALIZED for 2s [ 678.395127] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.611051] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1bc0c7fe-b55a-4de9-83ab-5b1a345baa3a tempest-ServersTestFqdnHostnames-1506153026 tempest-ServersTestFqdnHostnames-1506153026-project-member] Enqueued Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_rules [ 678.611618] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_rules [ 678.612812] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8db9dba-41a6-4390-8a03-e9d1a073b831 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.613026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.820830] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.820830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.820830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.822012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.822012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.822012] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 already deleted. [ 678.822012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.822012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.822012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.822012] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.898262] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.349143] env[65630]: INFO networking_nsxv3.common.synchronization [req-650e1ad0-4823-4423-b7bf-dc1555723feb req-93ef41f3-a331-4513-a593-61fd9f17f241 tempest-ImagesNegativeTestJSON-1195649101 tempest-ImagesNegativeTestJSON-1195649101-project-member] Enqueued Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_members [ 679.350097] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.350278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.350352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.350551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.350626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.350718] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 already deleted. [ 679.350797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.351408] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_members [ 679.351738] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.351929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.351929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.352521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.352521] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.352521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.352521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.352823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.352823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.352940] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.401378] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.401378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.401656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.401995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.402163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.402286] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 679.432691] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.432887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.432887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.433123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.433265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.442158] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 679.855505] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.855877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.855877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.856019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.856120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.856354] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.856495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.856567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.856748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.856834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.856949] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: effa588b-c067-4072-96e1-1b9dab231ed7 already deleted. [ 679.857063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.976192] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.976401] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-546" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.976520] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-546" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.976865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-546" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.977202] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.977361] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.977473] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.977695] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.977843] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.982947] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.983068] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.983196] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.983378] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.983476] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.983601] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.983774] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.007499] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.008369] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.008369] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.008369] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-546" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.008369] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-d1597b16-ac13-4644-9a11-3ebe0e3278fb taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.008737] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.008737] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.008997] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.009568] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1597b16-ac13-4644-9a11-3ebe0e3278fb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.159287] env[65630]: INFO networking_nsxv3.common.synchronization [req-f6ba1fb4-49c3-4c43-8d4a-9f75612a8e43 req-d5dbfbea-1a21-4872-8f0b-7128fffaa5e2 tempest-ServerExternalEventsTest-1404862039 tempest-ServerExternalEventsTest-1404862039-project-member] Enqueued Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_members [ 680.159287] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d with Priority: HIGHEST for action security_group_members [ 680.159287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4010c2f-2754-4e2d-949f-ec21a2348a3d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.159287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.159287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.159287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.159287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.159287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.159287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.159287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.159287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.159287] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4010c2f-2754-4e2d-949f-ec21a2348a3d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.382191] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d in Status: SUCCESS [ 680.382191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.382522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.382730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.383510] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.383510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.383510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.383510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.383510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.383893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.383893] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.513487] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.514343] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.514651] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.515230] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.515230] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.515814] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port d1597b16-ac13-4644-9a11-3ebe0e3278fb not found, creating... [ 680.516351] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.516871] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.518532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.518532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.518532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.518532] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.518532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.518532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.519036] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.519036] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.521359] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: d1597b16-ac13-4644-9a11-3ebe0e3278fb is going to be created. [ 680.546805] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.546805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.546805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.546805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.546805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.546805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.662940] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.663241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.663241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.663388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.663487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.663698] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.663803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.663900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.664039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.664123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.664216] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d is going to be updated. [ 680.712321] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.712597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.712597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.712794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.712965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.728881] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d in Status: IN_PROGRESS for 2s [ 680.886464] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.371438] env[65630]: INFO networking_nsxv3.common.synchronization [req-650e1ad0-4823-4423-b7bf-dc1555723feb req-a2769de7-3b87-4e7f-9c47-a03d72e4a67c service nova] Enqueued Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_rules [ 681.371438] env[65630]: INFO networking_nsxv3.common.synchronization [req-650e1ad0-4823-4423-b7bf-dc1555723feb req-a2769de7-3b87-4e7f-9c47-a03d72e4a67c service nova] Enqueued Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_members [ 681.371438] env[65630]: INFO networking_nsxv3.common.synchronization [req-650e1ad0-4823-4423-b7bf-dc1555723feb req-a2769de7-3b87-4e7f-9c47-a03d72e4a67c service nova] Enqueued Resource ID: d1597b16-ac13-4644-9a11-3ebe0e3278fb with Priority: HIGHEST for action port [ 681.371438] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_rules [ 681.371438] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_members [ 681.371438] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1597b16-ac13-4644-9a11-3ebe0e3278fb with Priority: HIGHEST for action port [ 681.371438] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.371438] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.371438] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.371438] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.371438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.375379] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.375379] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1597b16-ac13-4644-9a11-3ebe0e3278fb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.375379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.375379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.375379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.375379] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1597b16-ac13-4644-9a11-3ebe0e3278fb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.390904] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d: rpc.has_security_group_logging(os_id): False [ 681.412031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.412031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.412031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.412031] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d is going to be created. [ 681.454228] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 681.454562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.454663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.454820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.455033] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.455158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.455225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.455383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.455469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.455683] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.483905] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.483905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.483905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.483905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.483905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.495896] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d in Status: IN_PROGRESS for 2s [ 681.672260] env[65630]: INFO networking_nsxv3.common.synchronization [None req-86474528-bbe8-4b46-b452-302e5d41cddc None None] Enqueued Resource ID: 95a050c7-06e0-4b75-b8e9-32877d332b7f with Priority: HIGHEST for action port [ 681.672870] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95a050c7-06e0-4b75-b8e9-32877d332b7f with Priority: HIGHEST for action port [ 681.673302] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-95a050c7-06e0-4b75-b8e9-32877d332b7f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.673596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95a050c7-06e0-4b75-b8e9-32877d332b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.673596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95a050c7-06e0-4b75-b8e9-32877d332b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.674744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95a050c7-06e0-4b75-b8e9-32877d332b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.674903] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95a050c7-06e0-4b75-b8e9-32877d332b7f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.780353] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.782095] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.782336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.783447] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1597b16-ac13-4644-9a11-3ebe0e3278fb with status ACTIVE [ 681.783447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.783447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.783447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.783447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.783447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.783447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.783447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.784619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.784619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.784619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.784619] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.784619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.784619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.784619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.784619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.784619] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1597b16-ac13-4644-9a11-3ebe0e3278fb is going to be updated. [ 681.811373] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.811554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.811613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.811837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.811980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.812153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1597b16-ac13-4644-9a11-3ebe0e3278fb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.959505] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.177434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95a050c7-06e0-4b75-b8e9-32877d332b7f [ 682.177666] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.177800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.177871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.178110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.178220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.178305] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95a050c7-06e0-4b75-b8e9-32877d332b7f already deleted. [ 682.178426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95a050c7-06e0-4b75-b8e9-32877d332b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.289831] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.462307] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.743134] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d in Status: SUCCESS [ 682.743134] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4010c2f-2754-4e2d-949f-ec21a2348a3d deletion is rescheduled due to dependency. [ 682.743134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4010c2f-2754-4e2d-949f-ec21a2348a3d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.791845] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.792064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.792192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.792416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.792715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.792864] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: effa588b-c067-4072-96e1-1b9dab231ed7 is going to be created. [ 682.818418] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.818418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.818540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.818814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.818814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.828665] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: effa588b-c067-4072-96e1-1b9dab231ed7 in Status: UNINITIALIZED for 2s [ 682.966703] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.967101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.967101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.967246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.967323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.967864] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 683.006270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.006270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.006270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.006270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.006270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.016225] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 683.236153] env[65630]: INFO networking_nsxv3.common.synchronization [None req-04921159-8063-4a2b-9222-3d88a24c30ea None None] Enqueued Resource ID: 3cf24231-0a66-4b36-905f-9780525862f8 with Priority: HIGHEST for action port [ 683.242433] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf24231-0a66-4b36-905f-9780525862f8 with Priority: HIGHEST for action port [ 683.242433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf24231-0a66-4b36-905f-9780525862f8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.242433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf24231-0a66-4b36-905f-9780525862f8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.242433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf24231-0a66-4b36-905f-9780525862f8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.242433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf24231-0a66-4b36-905f-9780525862f8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.242433] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf24231-0a66-4b36-905f-9780525862f8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.510538] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d in Status: SUCCESS [ 683.510793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.628603] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1cb5a890-aa2c-421d-a84e-0c51a755c93a None None] Enqueued Resource ID: f5e80681-1e1a-43e8-8b25-006bfc7f933f with Priority: HIGHEST for action port [ 683.628603] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e80681-1e1a-43e8-8b25-006bfc7f933f with Priority: HIGHEST for action port [ 683.628603] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e80681-1e1a-43e8-8b25-006bfc7f933f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.628603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e80681-1e1a-43e8-8b25-006bfc7f933f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.628603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e80681-1e1a-43e8-8b25-006bfc7f933f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.631669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e80681-1e1a-43e8-8b25-006bfc7f933f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.631781] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e80681-1e1a-43e8-8b25-006bfc7f933f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.745209] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cf24231-0a66-4b36-905f-9780525862f8 [ 683.745209] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.745209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.745209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.745209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.745530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.745530] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cf24231-0a66-4b36-905f-9780525862f8 already deleted. [ 683.745530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf24231-0a66-4b36-905f-9780525862f8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.942048] env[65630]: INFO networking_nsxv3.common.synchronization [req-fd52b619-3259-45b1-a057-ab69e67347fb req-125db6c1-d86c-4bf6-a131-b21b358d0c71 tempest-ServerTagsTestJSON-1698832439 tempest-ServerTagsTestJSON-1698832439-project-member] Enqueued Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_members [ 683.942048] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_members [ 683.942298] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.942490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.942609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.942907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.943146] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.944045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.944045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.944045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.944045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.944045] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.134348] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5e80681-1e1a-43e8-8b25-006bfc7f933f [ 684.134725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.134940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.135060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.135380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.135517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.135659] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5e80681-1e1a-43e8-8b25-006bfc7f933f already deleted. [ 684.135788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e80681-1e1a-43e8-8b25-006bfc7f933f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.375548] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.376642] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-635" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.376642] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-635" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.376642] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-635" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.376642] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.376642] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.377061] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.377061] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.377704] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.377942] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.378065] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.378173] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.378308] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.378442] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.378523] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.378924] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.402178] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.402178] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.402282] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.402559] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-635" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.402754] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-971d6b98-b427-4c20-88bf-14ae8ea3207d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.402921] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.403041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.404141] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.404141] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('971d6b98-b427-4c20-88bf-14ae8ea3207d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.450588] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.451027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.451027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.451157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.451194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.451401] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.451559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.451658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.451902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.452015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.452110] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 already deleted. [ 684.452227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.838533] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: effa588b-c067-4072-96e1-1b9dab231ed7 in Status: SUCCESS [ 684.838748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.838910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.839145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.839329] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.839443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.839511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.839675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.839757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.839841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.839930] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.912691] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.912925] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.913062] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.913396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.913543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.913740] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 971d6b98-b427-4c20-88bf-14ae8ea3207d not found, creating... [ 684.914013] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.914179] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.914293] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.914515] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.914649] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.914931] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.915133] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.915255] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.915472] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.915605] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.915739] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 971d6b98-b427-4c20-88bf-14ae8ea3207d is going to be created. [ 684.935987] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.936219] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.936793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.936793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.936978] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.937071] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.037505] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 685.037505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.037625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.037775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.037964] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.040509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.040509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.040509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.040509] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.041567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.041666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.041775] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.041882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.041947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.042111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.042280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.042280] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.343512] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.343903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.343903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.343980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.344186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.344290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.344353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.344534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.344621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.344711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.344863] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.344974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.345048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.345197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.345342] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.345538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.345599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.345797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.345888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.345929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.346031] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.544636] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64208df3-7a31-4f66-a25a-21b69af6c4be: rpc.has_security_group_logging(os_id): False [ 685.546272] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.568029] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.570602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.570602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.571311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.572387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.572481] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.572989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.572989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.572989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.576284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.576579] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.577039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.577039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.577039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.577300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.577300] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.577408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.577499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.577676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.577777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.578292] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be created. [ 685.659831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.659980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.660064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.660342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.660628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.674081] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 685.714427] env[65630]: INFO networking_nsxv3.common.synchronization [req-fd52b619-3259-45b1-a057-ab69e67347fb req-89963190-d264-4149-a11a-647030e394f2 service nova] Enqueued Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_rules [ 685.714632] env[65630]: INFO networking_nsxv3.common.synchronization [req-fd52b619-3259-45b1-a057-ab69e67347fb req-89963190-d264-4149-a11a-647030e394f2 service nova] Enqueued Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_members [ 685.714769] env[65630]: INFO networking_nsxv3.common.synchronization [req-fd52b619-3259-45b1-a057-ab69e67347fb req-89963190-d264-4149-a11a-647030e394f2 service nova] Enqueued Resource ID: 971d6b98-b427-4c20-88bf-14ae8ea3207d with Priority: HIGHEST for action port [ 685.715194] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_rules [ 685.715194] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_members [ 685.715422] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 971d6b98-b427-4c20-88bf-14ae8ea3207d with Priority: HIGHEST for action port [ 685.716969] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.717293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.717293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.717559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.717639] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.718774] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.718937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.719051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.719266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.719635] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.720047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.720154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.720429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.720560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.720694] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.722516] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-971d6b98-b427-4c20-88bf-14ae8ea3207d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.722516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.723483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.723483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.723483] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('971d6b98-b427-4c20-88bf-14ae8ea3207d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.848425] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for effa588b-c067-4072-96e1-1b9dab231ed7: rpc.has_security_group_logging(os_id): False [ 685.867767] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.870614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.870820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.871140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.871358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.871724] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.872545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.873274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.873598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.873782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.874451] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.874744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.875353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.878311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.878484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.878836] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.881989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.883539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.885700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.885700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.885700] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: effa588b-c067-4072-96e1-1b9dab231ed7 is going to be created. [ 685.934221] env[65630]: INFO networking_nsxv3.common.synchronization [None req-28d6cc14-3eaf-4755-be11-456291c14d9b None None] Enqueued Resource ID: 5fe9e5f3-c7a9-4aa9-b338-1708f0354a82 with Priority: HIGHEST for action port [ 685.935030] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe9e5f3-c7a9-4aa9-b338-1708f0354a82 with Priority: HIGHEST for action port [ 685.938997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fe9e5f3-c7a9-4aa9-b338-1708f0354a82 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.939311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fe9e5f3-c7a9-4aa9-b338-1708f0354a82" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.939414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fe9e5f3-c7a9-4aa9-b338-1708f0354a82" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.939712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fe9e5f3-c7a9-4aa9-b338-1708f0354a82" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.939828] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe9e5f3-c7a9-4aa9-b338-1708f0354a82',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.947262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.947407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.947505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.947681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.947853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.960434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: effa588b-c067-4072-96e1-1b9dab231ed7 in Status: IN_PROGRESS for 2s [ 686.049047] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.223413] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.224966] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.225115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.226368] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 971d6b98-b427-4c20-88bf-14ae8ea3207d with status ACTIVE [ 686.227094] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.227094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.227094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.227094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.227094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.227560] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.227560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.227560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.227560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.227560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.227821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.227821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.227904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.229559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.229559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.229559] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 971d6b98-b427-4c20-88bf-14ae8ea3207d is going to be updated. [ 686.254231] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.254375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.254445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.254851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.254851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.254957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-971d6b98-b427-4c20-88bf-14ae8ea3207d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.424532] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a435dfc-8694-48e7-aa2e-1850b4b06826 req-7ea284b9-185e-4933-a55d-4b6854beab7b tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 686.425149] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 686.425464] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.427483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.427483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.427483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.427483] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.427483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.427483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.427483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.427483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.427483] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.445246] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fe9e5f3-c7a9-4aa9-b338-1708f0354a82 [ 686.445422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.445791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.445791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.445925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.446190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.446256] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fe9e5f3-c7a9-4aa9-b338-1708f0354a82 already deleted. [ 686.446515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fe9e5f3-c7a9-4aa9-b338-1708f0354a82" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.553154] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.553154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.553154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.553154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.553543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.553543] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 686.586333] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.586482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.586551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.586959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.587382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.599184] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 686.725920] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.862022] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-492 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.862022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.862022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.862022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.862022] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.862680] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.863020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.863407] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.863717] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.864074] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.864329] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.864580] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.866032] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.866032] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.866032] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.866032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.887032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.887032] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.887032] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.887032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.887427] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-5e57eda6-561c-47b1-a0a3-8131241445ad taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.887651] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.887843] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.888384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.888579] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e57eda6-561c-47b1-a0a3-8131241445ad',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.929018] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.231291] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.231291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.231291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.231291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.231291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.231291] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 is going to be created. [ 687.259307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.259512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.259584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.259785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.259945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.271091] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 in Status: UNINITIALIZED for 2s [ 687.391649] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.391893] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.391942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.392258] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.392415] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.392617] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 5e57eda6-561c-47b1-a0a3-8131241445ad not found, creating... [ 687.392896] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.393070] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.393216] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.393437] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.393574] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.394293] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.394486] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.394570] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.394768] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.394897] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.395062] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 5e57eda6-561c-47b1-a0a3-8131241445ad is going to be created. [ 687.419254] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.419465] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.419543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.419916] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.420188] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.420478] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.431656] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.692377] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 687.694972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.694972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.694972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.694972] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.934135] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.934691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.935086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.935393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.935520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.935658] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 687.965979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.966109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.966109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.966334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.966480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.975314] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: effa588b-c067-4072-96e1-1b9dab231ed7 in Status: SUCCESS [ 687.975588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.977160] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 688.148217] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a435dfc-8694-48e7-aa2e-1850b4b06826 req-186dd3dc-db0f-46e9-ba78-7a02f0871a6f service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 688.148217] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a435dfc-8694-48e7-aa2e-1850b4b06826 req-186dd3dc-db0f-46e9-ba78-7a02f0871a6f service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 688.148217] env[65630]: INFO networking_nsxv3.common.synchronization [req-4a435dfc-8694-48e7-aa2e-1850b4b06826 req-186dd3dc-db0f-46e9-ba78-7a02f0871a6f service nova] Enqueued Resource ID: 5e57eda6-561c-47b1-a0a3-8131241445ad with Priority: HIGHEST for action port [ 688.148217] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 688.148759] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 688.148759] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e57eda6-561c-47b1-a0a3-8131241445ad with Priority: HIGHEST for action port [ 688.148825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.149554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.149554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.149554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.149554] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.151038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.151151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.151369] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e57eda6-561c-47b1-a0a3-8131241445ad taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.151485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.151588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.151799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.151876] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e57eda6-561c-47b1-a0a3-8131241445ad',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.195473] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.195996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.258325] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7eb20fd8-b91e-4bbd-a4ea-2679b8a3efe4 None None] Enqueued Resource ID: 5602153f-df19-48f2-8d5e-82318fa30e7e with Priority: HIGHEST for action port [ 688.258884] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5602153f-df19-48f2-8d5e-82318fa30e7e with Priority: HIGHEST for action port [ 688.259023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5602153f-df19-48f2-8d5e-82318fa30e7e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.259163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5602153f-df19-48f2-8d5e-82318fa30e7e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.259245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5602153f-df19-48f2-8d5e-82318fa30e7e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.259532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5602153f-df19-48f2-8d5e-82318fa30e7e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.259639] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5602153f-df19-48f2-8d5e-82318fa30e7e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.614249] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.614249] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.614249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.614249] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.656376] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.656552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.658011] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e57eda6-561c-47b1-a0a3-8131241445ad with status ACTIVE [ 688.658186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.658312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.658592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.658673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.659713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.659713] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.659713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.659713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.659713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.659713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.659713] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.659713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.659713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.660695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.660695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.660695] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e57eda6-561c-47b1-a0a3-8131241445ad is going to be updated. [ 688.690402] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.690697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.690697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.690939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.691129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.691442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e57eda6-561c-47b1-a0a3-8131241445ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.766122] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5602153f-df19-48f2-8d5e-82318fa30e7e [ 688.766122] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.766122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.766122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.766122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.766122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.766122] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5602153f-df19-48f2-8d5e-82318fa30e7e already deleted. [ 688.766122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5602153f-df19-48f2-8d5e-82318fa30e7e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.119153] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.119153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.119153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.122031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.122031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.122031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.122031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.122031] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.281334] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 in Status: SUCCESS [ 689.282015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.282314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.282605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.282942] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.283351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.283470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.283827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.283986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.284075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.284173] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.625145] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64208df3-7a31-4f66-a25a-21b69af6c4be: rpc.has_security_group_logging(os_id): False [ 689.646718] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.647019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.647019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.647170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.647264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.647482] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.647607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.647717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.647782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.647858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.648053] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.648150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.648232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.648644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.648644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.648644] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.648804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.648804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.649393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.649393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.649393] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 689.727017] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.727279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.727279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.727442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.727658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.740844] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 689.787518] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.787792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.787792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.787997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.788197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.788371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.788443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.789289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.789407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.789516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.789691] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.789788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.789855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.790032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.790179] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.790322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.790386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.790613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.790726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.790822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.790923] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.990429] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 689.990429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.990429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.990798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.990798] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.991329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.991540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.991773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.992115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.992322] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.295576] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ab3235-b9b7-40f8-b1e6-960342fce805: rpc.has_security_group_logging(os_id): False [ 690.319646] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.320720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.321054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.321156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.321285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.321467] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.321589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.321696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.321877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.322079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.322191] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.323632] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.323632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.323632] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 is going to be created. [ 690.406346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.406764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.406983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.407386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.407687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.419792] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 in Status: IN_PROGRESS for 2s [ 690.495404] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.000736] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.195116] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e94b0b42-e5f3-47c9-a5d5-5ab180112dd6 None None] Enqueued Resource ID: 2cab7fc5-3757-4387-a16d-f77d9827640c with Priority: HIGHEST for action port [ 691.195116] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cab7fc5-3757-4387-a16d-f77d9827640c with Priority: HIGHEST for action port [ 691.195116] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cab7fc5-3757-4387-a16d-f77d9827640c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.195116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cab7fc5-3757-4387-a16d-f77d9827640c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.195116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cab7fc5-3757-4387-a16d-f77d9827640c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.195116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cab7fc5-3757-4387-a16d-f77d9827640c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.195116] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cab7fc5-3757-4387-a16d-f77d9827640c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.503204] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.503415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.503484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.503694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.503792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.503975] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 691.552376] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.552376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.553166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.553497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.553697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.570097] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 691.699618] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cab7fc5-3757-4387-a16d-f77d9827640c [ 691.699618] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.699618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.699618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.699618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.699618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.700019] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cab7fc5-3757-4387-a16d-f77d9827640c already deleted. [ 691.700019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cab7fc5-3757-4387-a16d-f77d9827640c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.760768] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 691.761098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.764240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.764240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.764240] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.270888] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.271299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.271299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.271651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.271892] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.272071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.272197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.272516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.272805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.275419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.275419] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.435243] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 in Status: SUCCESS [ 692.435740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.782979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.782979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.782979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.782979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.782979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.783606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.783606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.783606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.783606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.783606] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.286738] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64208df3-7a31-4f66-a25a-21b69af6c4be: rpc.has_security_group_logging(os_id): False [ 693.308797] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.308883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.308924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.309161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.309259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.309478] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.309772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.309772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.311541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.311541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.311541] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.311541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.311541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.311541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.311541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.311955] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.311955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.311955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.311955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.311955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.312163] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 693.387221] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.387221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.387221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.387221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.387221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.404835] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 693.584198] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 693.584932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.584932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.584932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.585138] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.585138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.585252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.585734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.585734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.585734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.585734] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.090128] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.090440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.090543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.090894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.090961] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.092270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.092270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.092270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.092993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.092993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.092993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.092993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.092993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.092993] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.466688] env[65630]: INFO networking_nsxv3.common.synchronization [None req-fe484019-7ceb-4d04-ad37-c334a0e7ed1a None None] Enqueued Resource ID: f84d15aa-f4e5-49fa-9ded-cf52684d8b7f with Priority: HIGHEST for action port [ 694.467292] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f84d15aa-f4e5-49fa-9ded-cf52684d8b7f with Priority: HIGHEST for action port [ 694.467591] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f84d15aa-f4e5-49fa-9ded-cf52684d8b7f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.467716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f84d15aa-f4e5-49fa-9ded-cf52684d8b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.467780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f84d15aa-f4e5-49fa-9ded-cf52684d8b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.468122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f84d15aa-f4e5-49fa-9ded-cf52684d8b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.468211] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f84d15aa-f4e5-49fa-9ded-cf52684d8b7f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.597516] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e647f36-5543-4052-8cd2-b972c5bc69c3: rpc.has_security_group_logging(os_id): False [ 694.639027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.639027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.639027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.639027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.640283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.641029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.641029] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.641029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.641029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.641282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.641282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.641377] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 694.748145] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.748145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.748145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.748145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.748145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.778885] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 694.970931] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f84d15aa-f4e5-49fa-9ded-cf52684d8b7f [ 694.971192] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.971399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.971499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.971724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.971814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.971910] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f84d15aa-f4e5-49fa-9ded-cf52684d8b7f already deleted. [ 694.971995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f84d15aa-f4e5-49fa-9ded-cf52684d8b7f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.420075] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 695.420075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.652247] env[65630]: INFO networking_nsxv3.common.synchronization [req-65b81f5d-6f73-4f85-97de-74da4e5f13bf req-93caecd2-24e1-49d8-96f2-506826ebaa31 tempest-SecurityGroupRulesTestJSON-1886688061 tempest-SecurityGroupRulesTestJSON-1886688061-project-member] Enqueued Resource ID: f3351c1d-01ba-48c9-a2a5-41c979f470c7 with Priority: HIGHEST for action security_group_rules [ 695.652247] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3351c1d-01ba-48c9-a2a5-41c979f470c7 with Priority: HIGHEST for action security_group_rules [ 695.652247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3351c1d-01ba-48c9-a2a5-41c979f470c7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.652247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3351c1d-01ba-48c9-a2a5-41c979f470c7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.652247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3351c1d-01ba-48c9-a2a5-41c979f470c7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.652247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3351c1d-01ba-48c9-a2a5-41c979f470c7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.652247] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3351c1d-01ba-48c9-a2a5-41c979f470c7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.176114] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.176114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.176114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.176504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.176504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.176504] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3351c1d-01ba-48c9-a2a5-41c979f470c7 already deleted. [ 696.176922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3351c1d-01ba-48c9-a2a5-41c979f470c7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.333485] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5afb23bb-b00c-41d0-9ff3-8ae2afb664bd None None] Enqueued Resource ID: f909fc6d-e2f7-4e72-8656-048a5400f2a7 with Priority: HIGHEST for action port [ 696.335069] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f909fc6d-e2f7-4e72-8656-048a5400f2a7 with Priority: HIGHEST for action port [ 696.335069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f909fc6d-e2f7-4e72-8656-048a5400f2a7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.335069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f909fc6d-e2f7-4e72-8656-048a5400f2a7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.335069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f909fc6d-e2f7-4e72-8656-048a5400f2a7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.335069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f909fc6d-e2f7-4e72-8656-048a5400f2a7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.335069] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f909fc6d-e2f7-4e72-8656-048a5400f2a7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.796337] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 696.796661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.838908] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f909fc6d-e2f7-4e72-8656-048a5400f2a7 [ 696.839224] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.839384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.839471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.839718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.839814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.841399] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f909fc6d-e2f7-4e72-8656-048a5400f2a7 already deleted. [ 696.841399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f909fc6d-e2f7-4e72-8656-048a5400f2a7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.010019] env[65630]: INFO networking_nsxv3.common.synchronization [None req-bb27d919-cc08-44fb-b083-4d5928afa29d None None] Enqueued Resource ID: 95445689-206b-4c65-ba35-58abb2ec3310 with Priority: HIGHEST for action port [ 697.010019] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95445689-206b-4c65-ba35-58abb2ec3310 with Priority: HIGHEST for action port [ 697.010019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-95445689-206b-4c65-ba35-58abb2ec3310 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.010019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95445689-206b-4c65-ba35-58abb2ec3310" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.010019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95445689-206b-4c65-ba35-58abb2ec3310" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.010019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95445689-206b-4c65-ba35-58abb2ec3310" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.010019] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95445689-206b-4c65-ba35-58abb2ec3310',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.515764] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95445689-206b-4c65-ba35-58abb2ec3310 [ 697.515764] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.515764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.515764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.515764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.516579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.516579] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95445689-206b-4c65-ba35-58abb2ec3310 already deleted. [ 697.516579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95445689-206b-4c65-ba35-58abb2ec3310" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.577073] env[65630]: INFO networking_nsxv3.common.synchronization [req-7f4cf45f-7b37-4127-9d09-e86ad4addaa4 req-9acf0e1f-546d-4c70-9577-c8de06d13fd6 tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 697.578225] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 697.578225] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.580241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.580668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.582027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.582027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.582027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.582027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.582027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.582027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.582027] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.084211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.084539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.084539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.088028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.088028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.088028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.088028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.088028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.088028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.088028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.088028] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e already deleted. [ 698.088028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.125902] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.125902] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.125902] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.126426] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.126623] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.126783] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.126896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.127143] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.127401] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.127502] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.127585] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.127725] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.127838] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.127944] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.128056] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.128189] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.158020] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.158020] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.158020] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.158020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.158020] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-1a9eba58-667b-4615-8bd1-f3b3842ab324 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.158020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.158020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.158020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.158020] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a9eba58-667b-4615-8bd1-f3b3842ab324',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.502898] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a66003f4-87ff-4f4e-8d13-00da40bd0bd0 None None] Enqueued Resource ID: fb09aef2-cb6e-4e70-b9d1-01f9374fb403 with Priority: HIGHEST for action port [ 698.503458] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb09aef2-cb6e-4e70-b9d1-01f9374fb403 with Priority: HIGHEST for action port [ 698.503768] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb09aef2-cb6e-4e70-b9d1-01f9374fb403 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.503893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb09aef2-cb6e-4e70-b9d1-01f9374fb403" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.503953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb09aef2-cb6e-4e70-b9d1-01f9374fb403" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.504246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb09aef2-cb6e-4e70-b9d1-01f9374fb403" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.504361] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb09aef2-cb6e-4e70-b9d1-01f9374fb403',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.663272] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.663272] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.663554] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.663889] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.664429] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.664429] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 1a9eba58-667b-4615-8bd1-f3b3842ab324 not found, creating... [ 698.664603] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.664709] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.664861] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.665303] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.665462] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.666116] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.666116] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.666116] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.666283] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.666511] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.666795] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 1a9eba58-667b-4615-8bd1-f3b3842ab324 is going to be created. [ 698.689092] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.689092] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.689372] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.689549] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.689785] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.690066] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.006600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb09aef2-cb6e-4e70-b9d1-01f9374fb403 [ 699.006820] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.006988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.007080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.007312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.007567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.007716] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb09aef2-cb6e-4e70-b9d1-01f9374fb403 already deleted. [ 699.007795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb09aef2-cb6e-4e70-b9d1-01f9374fb403" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.322813] env[65630]: INFO networking_nsxv3.common.synchronization [None req-67ddda19-f678-4acf-9c91-a866b12d81b8 None None] Enqueued Resource ID: a044da6a-5320-4c47-bcef-44f5b694fe95 with Priority: HIGHEST for action port [ 699.323798] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a044da6a-5320-4c47-bcef-44f5b694fe95 with Priority: HIGHEST for action port [ 699.324131] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a044da6a-5320-4c47-bcef-44f5b694fe95 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.324284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a044da6a-5320-4c47-bcef-44f5b694fe95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.324364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a044da6a-5320-4c47-bcef-44f5b694fe95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.324632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a044da6a-5320-4c47-bcef-44f5b694fe95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.324730] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a044da6a-5320-4c47-bcef-44f5b694fe95',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.446822] env[65630]: INFO networking_nsxv3.common.synchronization [req-7f4cf45f-7b37-4127-9d09-e86ad4addaa4 req-f6f0655f-85e7-4485-91d2-32cb8b56a9e7 service nova] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_rules [ 699.446822] env[65630]: INFO networking_nsxv3.common.synchronization [req-7f4cf45f-7b37-4127-9d09-e86ad4addaa4 req-f6f0655f-85e7-4485-91d2-32cb8b56a9e7 service nova] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 699.446822] env[65630]: INFO networking_nsxv3.common.synchronization [req-7f4cf45f-7b37-4127-9d09-e86ad4addaa4 req-f6f0655f-85e7-4485-91d2-32cb8b56a9e7 service nova] Enqueued Resource ID: 1a9eba58-667b-4615-8bd1-f3b3842ab324 with Priority: HIGHEST for action port [ 699.446822] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_rules [ 699.446822] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 699.447274] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a9eba58-667b-4615-8bd1-f3b3842ab324 with Priority: HIGHEST for action port [ 699.447595] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.447738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.447798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.448076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.448157] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.449465] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.449583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.449649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.449833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.450186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.450186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.450186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.450317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.450396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.450501] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.451355] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a9eba58-667b-4615-8bd1-f3b3842ab324 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.451513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.454514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.454817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.454939] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a9eba58-667b-4615-8bd1-f3b3842ab324',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.827682] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a044da6a-5320-4c47-bcef-44f5b694fe95 [ 699.827937] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.828094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.828166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.828471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.828654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.828750] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a044da6a-5320-4c47-bcef-44f5b694fe95 already deleted. [ 699.828847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a044da6a-5320-4c47-bcef-44f5b694fe95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.957765] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.961021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.961021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.961021] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a9eba58-667b-4615-8bd1-f3b3842ab324 with status ACTIVE [ 699.961021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.961021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.961021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.961021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.961021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.961460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.961460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.961460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.961460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.961616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.961740] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.961833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.961891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.962462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.963078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.963078] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a9eba58-667b-4615-8bd1-f3b3842ab324 is going to be updated. [ 699.992163] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.992163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.992163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.992163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.992163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.992402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a9eba58-667b-4615-8bd1-f3b3842ab324" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.347514] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b42dfbe2-2463-4cfa-b197-0ef57969dcbd tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_rules [ 700.348096] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_rules [ 700.348632] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.348632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.348632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.348875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.348960] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.465408] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.739653] env[65630]: INFO networking_nsxv3.common.synchronization [None req-815b196c-b49c-4d2a-9636-5186ca00bdbc tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_rules [ 700.740256] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_rules [ 700.740649] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.740800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.874206] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.875048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.876050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.876050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.876050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.876050] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b already deleted. [ 700.876050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.876564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.876564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.876742] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.969507] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.969713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.969831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.970018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.970111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.970212] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be created. [ 700.996017] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.996203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.996739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.996739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.996739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.006977] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: UNINITIALIZED for 2s [ 701.401670] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.402023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.402023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.402163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.402237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.402308] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b already deleted. [ 701.402376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.032413] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 703.032670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.033497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.033497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.033497] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.033497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.033497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.033795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.033795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.033795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.033909] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.183433] env[65630]: INFO networking_nsxv3.common.synchronization [None req-3f3bd001-afcd-45f0-92f1-65ac0fe095c3 None None] Enqueued Resource ID: 0294bdf6-45a8-4a8b-b75d-637fa2991b3b with Priority: HIGHEST for action port [ 703.183433] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0294bdf6-45a8-4a8b-b75d-637fa2991b3b with Priority: HIGHEST for action port [ 703.183685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0294bdf6-45a8-4a8b-b75d-637fa2991b3b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.183922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0294bdf6-45a8-4a8b-b75d-637fa2991b3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.183922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0294bdf6-45a8-4a8b-b75d-637fa2991b3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.184588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0294bdf6-45a8-4a8b-b75d-637fa2991b3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.184588] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0294bdf6-45a8-4a8b-b75d-637fa2991b3b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.537143] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.538834] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.538834] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.538834] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.538834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.539523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.541226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.541352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.541504] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.688325] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0294bdf6-45a8-4a8b-b75d-637fa2991b3b [ 703.688672] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.688971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.688971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.689586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.689586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.689586] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0294bdf6-45a8-4a8b-b75d-637fa2991b3b already deleted. [ 703.689928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0294bdf6-45a8-4a8b-b75d-637fa2991b3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.045965] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0aff3db7-d7a7-4b84-8908-260cd4cfa00e: rpc.has_security_group_logging(os_id): False [ 704.064855] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.065529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.065529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.065529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.065529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.065814] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.065814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.065941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.066031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.066109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.066314] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.066401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.066447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.066588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.066655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.066821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.066900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.066962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.067376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.067376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.067376] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be created. [ 704.144329] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.144477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.144537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.144773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.145012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.159545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 704.310106] env[65630]: INFO networking_nsxv3.common.synchronization [req-64ef6613-48a2-4370-a9d5-d1adecf7f664 req-079e9184-df3d-4270-8897-452b58388b7d tempest-ServerDiagnosticsNegativeTest-1476230730 tempest-ServerDiagnosticsNegativeTest-1476230730-project-member] Enqueued Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_members [ 704.314022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGHEST for action security_group_members [ 704.314022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.314022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.314022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.314022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.314022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.314022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.314022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.314022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.314022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.314022] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.752642] env[65630]: INFO networking_nsxv3.common.synchronization [None req-55f331da-0bf7-476a-89a5-324dc70219d7 None None] Enqueued Resource ID: 01ef8fae-7332-40b4-bc8a-5668891de6d9 with Priority: HIGHEST for action port [ 704.756101] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01ef8fae-7332-40b4-bc8a-5668891de6d9 with Priority: HIGHEST for action port [ 704.756783] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-01ef8fae-7332-40b4-bc8a-5668891de6d9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.757157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01ef8fae-7332-40b4-bc8a-5668891de6d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.757229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01ef8fae-7332-40b4-bc8a-5668891de6d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.757596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01ef8fae-7332-40b4-bc8a-5668891de6d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.757752] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01ef8fae-7332-40b4-bc8a-5668891de6d9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.816658] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.816658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.816925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.817020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.817058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.819038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.819038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.819038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.819038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.819038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.819038] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 is going to be updated. [ 704.859087] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.861669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.861795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.862536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.862739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.874806] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 in Status: IN_PROGRESS for 2s [ 705.261085] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01ef8fae-7332-40b4-bc8a-5668891de6d9 [ 705.261085] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.261085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.261085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.261085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.261634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.261634] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01ef8fae-7332-40b4-bc8a-5668891de6d9 already deleted. [ 705.261634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01ef8fae-7332-40b4-bc8a-5668891de6d9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.172410] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 706.172626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.396499] env[65630]: INFO networking_nsxv3.common.synchronization [req-badae48f-7b5f-48fd-bb15-614b7ce90684 req-c9e11152-b279-41b3-a0b1-00f67b2830f6 tempest-ServersTestFqdnHostnames-1506153026 tempest-ServersTestFqdnHostnames-1506153026-project-member] Enqueued Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_members [ 706.397015] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_members [ 706.397306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8db9dba-41a6-4390-8a03-e9d1a073b831 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.397431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.397496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.397740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.397892] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.398023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.398791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.398872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.398939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.399053] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.899776] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 in Status: SUCCESS [ 706.900030] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 deletion is rescheduled due to dependency. [ 706.900203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.900645] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.900940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.900940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.901223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.901343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.901571] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.901684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.901753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.901949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.907591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.907591] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 already deleted. [ 706.907591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.009227] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.009227] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-962" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.009227] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-962" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.012057] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-962" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.013034] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.013034] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.013034] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.013335] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.013377] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.013567] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.013724] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.014220] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.014220] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.014220] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.014220] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.014445] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.038552] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.038782] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.038947] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.039244] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-962" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.039736] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-f07152ae-51b0-4168-9968-bef2cc67e017 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.040040] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.043296] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.043721] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.043911] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f07152ae-51b0-4168-9968-bef2cc67e017',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.550135] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.550775] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.550775] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.550938] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.551080] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.551239] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port f07152ae-51b0-4168-9968-bef2cc67e017 not found, creating... [ 707.551521] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.551684] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.551794] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.552018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.552160] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.552454] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.552675] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.552841] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.553087] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.553217] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.553362] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: f07152ae-51b0-4168-9968-bef2cc67e017 is going to be created. [ 707.574914] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.575200] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.575324] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.575608] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.575834] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.576118] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.269485] env[65630]: INFO networking_nsxv3.common.synchronization [req-badae48f-7b5f-48fd-bb15-614b7ce90684 req-31761e9e-6248-4209-b7a2-99bae61f9471 service nova] Enqueued Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_rules [ 708.269485] env[65630]: INFO networking_nsxv3.common.synchronization [req-badae48f-7b5f-48fd-bb15-614b7ce90684 req-31761e9e-6248-4209-b7a2-99bae61f9471 service nova] Enqueued Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_members [ 708.269485] env[65630]: INFO networking_nsxv3.common.synchronization [req-badae48f-7b5f-48fd-bb15-614b7ce90684 req-31761e9e-6248-4209-b7a2-99bae61f9471 service nova] Enqueued Resource ID: f07152ae-51b0-4168-9968-bef2cc67e017 with Priority: HIGHEST for action port [ 708.270412] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_rules [ 708.270606] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_members [ 708.270737] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07152ae-51b0-4168-9968-bef2cc67e017 with Priority: HIGHEST for action port [ 708.270984] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8db9dba-41a6-4390-8a03-e9d1a073b831 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.271310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.271384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.271632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.271718] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.274725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8db9dba-41a6-4390-8a03-e9d1a073b831 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.274847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.274918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.275156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.275321] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.276763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.276867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.277089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.277171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.277274] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.278078] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f07152ae-51b0-4168-9968-bef2cc67e017 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.278180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.278247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.278402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.278591] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f07152ae-51b0-4168-9968-bef2cc67e017',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.726953] env[65630]: INFO networking_nsxv3.common.synchronization [None req-0d16e30e-6072-475c-9381-f47d6c9cd780 None None] Enqueued Resource ID: 43116a48-8d92-4a70-a4cb-ffaadb2a5393 with Priority: HIGHEST for action port [ 708.727553] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43116a48-8d92-4a70-a4cb-ffaadb2a5393 with Priority: HIGHEST for action port [ 708.729216] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-43116a48-8d92-4a70-a4cb-ffaadb2a5393 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.729468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43116a48-8d92-4a70-a4cb-ffaadb2a5393" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.729544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43116a48-8d92-4a70-a4cb-ffaadb2a5393" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.729910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43116a48-8d92-4a70-a4cb-ffaadb2a5393" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.729980] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43116a48-8d92-4a70-a4cb-ffaadb2a5393',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.781351] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8db9dba-41a6-4390-8a03-e9d1a073b831 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.781351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.781351] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.783586] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f07152ae-51b0-4168-9968-bef2cc67e017 with status ACTIVE [ 708.783775] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.784829] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.784829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.785330] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.785330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.785330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.785330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.785575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.785575] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f07152ae-51b0-4168-9968-bef2cc67e017 is going to be updated. [ 708.806930] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.807055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.807055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.807245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.808375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.808375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f07152ae-51b0-4168-9968-bef2cc67e017" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.234158] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43116a48-8d92-4a70-a4cb-ffaadb2a5393 [ 709.235082] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.235235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.235303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.235524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.235610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.235709] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43116a48-8d92-4a70-a4cb-ffaadb2a5393 already deleted. [ 709.235788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43116a48-8d92-4a70-a4cb-ffaadb2a5393" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.284277] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.546022] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c6bbdfe-5dd8-4b55-99a2-27a6e43ffc8b req-9cfda029-4490-4af5-ba00-ed3f781a8e07 tempest-FloatingIPsAssociationNegativeTestJSON-1445942793 tempest-FloatingIPsAssociationNegativeTestJSON-1445942793-project-member] Enqueued Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_members [ 709.546022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGHEST for action security_group_members [ 709.549223] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.550520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.550520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.550520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.550520] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.550520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.550520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.550520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.550520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.550520] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.789875] env[65630]: INFO networking_nsxv3.common.synchronization [req-0939aa6b-a1dc-4f0e-8764-bef9cfbd2938 req-e0856db5-1d18-4da6-91ad-8910fe0ed6b0 tempest-ServerMetadataNegativeTestJSON-1004137549 tempest-ServerMetadataNegativeTestJSON-1004137549-project-member] Enqueued Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_members [ 709.790401] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.790577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.790648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.790858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.790959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.791139] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 is going to be created. [ 709.792669] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_members [ 709.793405] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.793522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.795016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.795016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.795016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.795016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.795016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.795016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.795016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.795016] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.839507] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.839507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.839507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.839507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.839507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.853423] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 in Status: UNINITIALIZED for 2s [ 709.935636] env[65630]: INFO networking_nsxv3.common.synchronization [None req-4c44e217-c946-4e3c-a160-2dcb257fd114 None None] Enqueued Resource ID: 6fee5915-83c8-4b53-967f-49c27c5b54f5 with Priority: HIGHEST for action port [ 709.936237] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fee5915-83c8-4b53-967f-49c27c5b54f5 with Priority: HIGHEST for action port [ 709.936557] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fee5915-83c8-4b53-967f-49c27c5b54f5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.936684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fee5915-83c8-4b53-967f-49c27c5b54f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.936741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fee5915-83c8-4b53-967f-49c27c5b54f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.937028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fee5915-83c8-4b53-967f-49c27c5b54f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.937756] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fee5915-83c8-4b53-967f-49c27c5b54f5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.053059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.053059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.053059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.053287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.053287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.053691] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.054191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.054191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.054191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.054340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.054340] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff is going to be updated. [ 710.090262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.090498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.090558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.090834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.090980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.100782] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff in Status: IN_PROGRESS for 2s [ 710.299538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.299538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.299538] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a already deleted. [ 710.299538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.440065] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fee5915-83c8-4b53-967f-49c27c5b54f5 [ 710.440313] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.440449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.440578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.440794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.440884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.440981] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fee5915-83c8-4b53-967f-49c27c5b54f5 already deleted. [ 710.441081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fee5915-83c8-4b53-967f-49c27c5b54f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.011367] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.011845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-834" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.011845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-834" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.012118] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-834" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.012762] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.012916] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.013469] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.014465] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.014465] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.014465] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.014465] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.014465] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.014465] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.014750] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.014750] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.014869] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.037360] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.037360] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.037525] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.037679] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-834" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.037974] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.038143] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.038253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.038565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.038691] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('490aab1d-4b0f-4eb3-879a-2f39ebbfefaf',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.275745] env[65630]: INFO networking_nsxv3.common.synchronization [None req-3d87d3ad-1638-4f78-b135-8189bc11ab78 None None] Enqueued Resource ID: dfb0a757-f94f-4be0-a89d-45afe7620638 with Priority: HIGHEST for action port [ 711.276464] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb0a757-f94f-4be0-a89d-45afe7620638 with Priority: HIGHEST for action port [ 711.276829] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb0a757-f94f-4be0-a89d-45afe7620638 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.277384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb0a757-f94f-4be0-a89d-45afe7620638" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.277384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb0a757-f94f-4be0-a89d-45afe7620638" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.277384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb0a757-f94f-4be0-a89d-45afe7620638" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.277538] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb0a757-f94f-4be0-a89d-45afe7620638',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.541653] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.542141] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.542358] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.542844] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.543282] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.543282] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 490aab1d-4b0f-4eb3-879a-2f39ebbfefaf not found, creating... [ 711.543801] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.543801] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.544023] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.544431] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.544431] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.545149] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.545149] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.545312] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.545723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.545723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.546709] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 490aab1d-4b0f-4eb3-879a-2f39ebbfefaf is going to be created. [ 711.568117] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.568304] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.568406] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.568730] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.568953] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.569201] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.780206] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfb0a757-f94f-4be0-a89d-45afe7620638 [ 711.780449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.781287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.781399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.781808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.783260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.783260] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfb0a757-f94f-4be0-a89d-45afe7620638 already deleted. [ 711.783260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb0a757-f94f-4be0-a89d-45afe7620638" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.869455] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 in Status: SUCCESS [ 711.869702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.869885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.870125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.870311] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.870415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.870517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.870655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.870755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.870877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.870952] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.881875] env[65630]: INFO networking_nsxv3.common.synchronization [None req-81c77a45-72a3-42d6-8787-a71b17bef353 None None] Enqueued Resource ID: 90b7d5cf-1077-43c2-b15f-6603c31b6c3f with Priority: HIGHEST for action port [ 711.882308] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90b7d5cf-1077-43c2-b15f-6603c31b6c3f with Priority: HIGHEST for action port [ 711.883137] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-90b7d5cf-1077-43c2-b15f-6603c31b6c3f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.883273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90b7d5cf-1077-43c2-b15f-6603c31b6c3f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.883341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90b7d5cf-1077-43c2-b15f-6603c31b6c3f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.883597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90b7d5cf-1077-43c2-b15f-6603c31b6c3f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.883680] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90b7d5cf-1077-43c2-b15f-6603c31b6c3f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.112422] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff in Status: SUCCESS [ 712.112791] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff deletion is rescheduled due to dependency. [ 712.112791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.282832] env[65630]: INFO networking_nsxv3.common.synchronization [req-0939aa6b-a1dc-4f0e-8764-bef9cfbd2938 req-7dc69af6-6c61-4fa2-bade-d829548cd3fe service nova] Enqueued Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_rules [ 712.283044] env[65630]: INFO networking_nsxv3.common.synchronization [req-0939aa6b-a1dc-4f0e-8764-bef9cfbd2938 req-7dc69af6-6c61-4fa2-bade-d829548cd3fe service nova] Enqueued Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_members [ 712.284059] env[65630]: INFO networking_nsxv3.common.synchronization [req-0939aa6b-a1dc-4f0e-8764-bef9cfbd2938 req-7dc69af6-6c61-4fa2-bade-d829548cd3fe service nova] Enqueued Resource ID: 490aab1d-4b0f-4eb3-879a-2f39ebbfefaf with Priority: HIGHEST for action port [ 712.284059] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_rules [ 712.284059] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_members [ 712.284059] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490aab1d-4b0f-4eb3-879a-2f39ebbfefaf with Priority: HIGHEST for action port [ 712.284314] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.284459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.284508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.284802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.284863] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.286154] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.286154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.286154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.287829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.287829] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.287829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.287829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.287829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.287829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.287829] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.289800] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.289800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.289800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.289800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.289800] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('490aab1d-4b0f-4eb3-879a-2f39ebbfefaf',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.374594] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.385705] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90b7d5cf-1077-43c2-b15f-6603c31b6c3f [ 712.386262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.386262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.386262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.386671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.386671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.386801] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90b7d5cf-1077-43c2-b15f-6603c31b6c3f already deleted. [ 712.386852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90b7d5cf-1077-43c2-b15f-6603c31b6c3f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.764028] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-7cbd135b-6d7b-40f2-a63e-17d35b318a92 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 712.764028] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 712.764028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.764028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.764028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.764028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.764028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.764028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.764028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.764028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.764028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.764028] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.793589] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.794224] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.794342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.794492] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 490aab1d-4b0f-4eb3-879a-2f39ebbfefaf with status ACTIVE [ 712.794672] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.794750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.794813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.795699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.795699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.795699] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.795699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.795699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.795699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.795699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.796355] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.796355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.796355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.798048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.798048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.798048] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 490aab1d-4b0f-4eb3-879a-2f39ebbfefaf is going to be updated. [ 712.822287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.822287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.822287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.822451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.822666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.822666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-490aab1d-4b0f-4eb3-879a-2f39ebbfefaf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.878420] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8db9dba-41a6-4390-8a03-e9d1a073b831: rpc.has_security_group_logging(os_id): False [ 712.901027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.901027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.901027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.901027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 is going to be created. [ 712.993741] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.993897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.993970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.994204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.994378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.011528] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 in Status: IN_PROGRESS for 2s [ 713.267604] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.268914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.268914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.268914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.268914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.268914] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.268914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.269161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.269161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.269392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.269392] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 already deleted. [ 713.269463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.299941] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.344872] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-87306cad-0f5e-4d61-b881-b3ab1b2af3c6 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 713.345651] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 713.345965] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.346184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.346252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.346454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.346697] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.346764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.347533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.347724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.347820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.347920] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.661552] env[65630]: INFO networking_nsxv3.common.synchronization [req-ec647415-fdad-4cf1-8a5a-fefaa8a53c19 req-f83385e3-de63-4071-a18e-dddebffce4ad tempest-ListServersNegativeTestJSON-1633369316 tempest-ListServersNegativeTestJSON-1633369316-project-member] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 713.662170] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 713.662497] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.662594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.662658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.662906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.665206] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.665376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.665423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.665596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.665704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.665774] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.803042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.803042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.803042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.803042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.803042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.803042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a is going to be created. [ 713.826875] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.827056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.827093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.827794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.827990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.839319] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a in Status: UNINITIALIZED for 2s [ 713.852766] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.852766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.852766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.852766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.853029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.853099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.853251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.853336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.853493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.853567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.853650] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 already deleted. [ 713.853722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.089477] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-cdaa4ba0-afae-48b0-b53d-fe86830ff44c tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 714.090622] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 714.090954] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.093124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.093215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.093803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.094016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.094132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.094197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.094374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.094462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.094565] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.123018] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e8e1282c-981b-498e-b6b9-ee96b6550e2b None None] Enqueued Resource ID: 53974cbd-2156-4501-8799-0435655c643f with Priority: HIGHEST for action port [ 714.124571] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53974cbd-2156-4501-8799-0435655c643f with Priority: HIGHEST for action port [ 714.124571] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-53974cbd-2156-4501-8799-0435655c643f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.124571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53974cbd-2156-4501-8799-0435655c643f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.124571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53974cbd-2156-4501-8799-0435655c643f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.124804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53974cbd-2156-4501-8799-0435655c643f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.125086] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53974cbd-2156-4501-8799-0435655c643f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.170320] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.475435] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5cfc3c15-1db6-4044-a2d4-751c91c593d4 None None] Enqueued Resource ID: 34d10816-a9d2-4de4-952b-dccb85246645 with Priority: HIGHEST for action port [ 714.475961] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d10816-a9d2-4de4-952b-dccb85246645 with Priority: HIGHEST for action port [ 714.476308] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-34d10816-a9d2-4de4-952b-dccb85246645 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.476428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34d10816-a9d2-4de4-952b-dccb85246645" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.476496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34d10816-a9d2-4de4-952b-dccb85246645" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.476744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34d10816-a9d2-4de4-952b-dccb85246645" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.476825] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34d10816-a9d2-4de4-952b-dccb85246645',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.598493] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.598757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.598825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.599148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.599238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.599513] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.599630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.599718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.599937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.600066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.600157] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 already deleted. [ 714.600241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.629376] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53974cbd-2156-4501-8799-0435655c643f [ 714.629984] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.629984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.629984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.630204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.630236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.630397] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53974cbd-2156-4501-8799-0435655c643f already deleted. [ 714.630397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53974cbd-2156-4501-8799-0435655c643f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.673063] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.869870] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.869870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.869870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.869870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.870744] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.870941] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.871066] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.871307] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.872723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.872723] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.872723] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.872723] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.872723] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.872723] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.872723] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.872723] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.893600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.893762] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.895069] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.895069] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.895069] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-481e2a3c-bbb9-44e3-b351-85dd03029ed0 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.895069] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.895069] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.895069] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.895497] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('481e2a3c-bbb9-44e3-b351-85dd03029ed0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.981374] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34d10816-a9d2-4de4-952b-dccb85246645 [ 714.981667] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.981760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.981806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.982020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.982117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.982216] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34d10816-a9d2-4de4-952b-dccb85246645 already deleted. [ 714.983120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34d10816-a9d2-4de4-952b-dccb85246645" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.984199] env[65630]: INFO networking_nsxv3.common.synchronization [req-d19bd8f3-0d47-46c6-979c-b2cb3e39cd4a req-9af78d04-d19d-42fc-a382-42cbed16e010 tempest-ImagesNegativeTestJSON-1195649101 tempest-ImagesNegativeTestJSON-1195649101-project-member] Enqueued Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_members [ 714.984753] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGHEST for action security_group_members [ 714.985081] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.985168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.985246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.985419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.985565] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.985663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.985726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.985873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.985955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.987131] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.027740] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 in Status: SUCCESS [ 715.027740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.177412] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.177565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.177639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.178086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.178280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.178451] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 715.225069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.225069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.225340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.225425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.225875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.236389] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 715.399830] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.399830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.399830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.399830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.399830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.399830] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 481e2a3c-bbb9-44e3-b351-85dd03029ed0 not found, creating... [ 715.399830] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.400616] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.400844] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.401276] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.401564] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.401968] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.402235] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.402456] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.402747] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.402888] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.403085] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 481e2a3c-bbb9-44e3-b351-85dd03029ed0 is going to be created. [ 715.425778] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.425983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.426035] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.426352] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.426541] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.426806] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.473193] env[65630]: INFO networking_nsxv3.common.synchronization [req-e4e9db94-b61e-45b2-8958-e50376ed71b8 req-b45cb346-ea9f-4d34-aaae-9d41b936f934 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 715.473778] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 715.474231] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.474231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.474372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.474705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.474705] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.474824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.474870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.474988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.476806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.477056] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.489749] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.489820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.489854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.490119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.490227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.490657] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.490657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.490657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.490823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.490823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.490949] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: effa588b-c067-4072-96e1-1b9dab231ed7 is going to be updated. [ 715.526609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.526812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.526812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.527035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.527180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.536867] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: effa588b-c067-4072-96e1-1b9dab231ed7 in Status: IN_PROGRESS for 2s [ 715.849398] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a in Status: SUCCESS [ 715.849592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.849758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.849970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.850167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.850285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.850349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.850499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.850593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.850685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.850773] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.980247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.980401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.980473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.980745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.980834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.981050] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.981157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.981221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.981380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.981458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.981565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 already deleted. [ 715.981652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.982771] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.982993] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-444" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.983159] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-444" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.983482] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-444" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.984285] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.984285] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.984285] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.984285] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.984532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.984768] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.984911] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.985058] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.985201] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.985351] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.985485] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.985613] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.010984] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.011163] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.011294] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.011465] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-444" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.011996] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.012254] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.012399] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.012742] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.012925] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be0978ab-a6bb-4d8a-ad28-02f96e1acd56',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.124362] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-9abf30e8-6efb-4f48-8c59-3777d775f57d service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 716.124674] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-9abf30e8-6efb-4f48-8c59-3777d775f57d service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 716.124674] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-9abf30e8-6efb-4f48-8c59-3777d775f57d service nova] Enqueued Resource ID: 481e2a3c-bbb9-44e3-b351-85dd03029ed0 with Priority: HIGHEST for action port [ 716.125503] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 716.125680] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 716.125837] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 481e2a3c-bbb9-44e3-b351-85dd03029ed0 with Priority: HIGHEST for action port [ 716.126102] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.126228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.126302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.127121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.127121] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.128027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.128606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.128697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.128894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.129070] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.129176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.129280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.129443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.129548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.129657] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.131099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-481e2a3c-bbb9-44e3-b351-85dd03029ed0 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.131212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.131280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.131439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.131554] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('481e2a3c-bbb9-44e3-b351-85dd03029ed0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.353710] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.353904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.353983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.354266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.354451] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.354556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.354622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.354781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.354872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.354962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.355131] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.355239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.355312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.355466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.355611] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.355705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.355766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.355908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.355988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.356108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.356208] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.515334] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.515692] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.515778] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.516119] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.516305] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.516491] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port be0978ab-a6bb-4d8a-ad28-02f96e1acd56 not found, creating... [ 716.516789] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.517038] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.517167] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.517393] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.517528] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.517809] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.517963] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.518151] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.518950] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.519147] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.519323] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 is going to be created. [ 716.539103] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.539325] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.539445] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.539714] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.539933] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.540199] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.632786] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.633845] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.633951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.635295] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 481e2a3c-bbb9-44e3-b351-85dd03029ed0 with status ACTIVE [ 716.635479] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.637120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.637207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.637456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.637556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.637990] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.637990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.637990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.638254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.638254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.638455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.638614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.638614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.638777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.638855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.639271] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 481e2a3c-bbb9-44e3-b351-85dd03029ed0 is going to be updated. [ 716.673550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.673711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.673786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.674018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.674587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.674587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-481e2a3c-bbb9-44e3-b351-85dd03029ed0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.780913] env[65630]: INFO networking_nsxv3.common.synchronization [None req-d17366fc-f816-4a5e-b8a2-7f71c4f00ce5 None None] Enqueued Resource ID: 557973ee-2947-4987-afbb-a81d7ab1cde3 with Priority: HIGHEST for action port [ 716.781418] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 557973ee-2947-4987-afbb-a81d7ab1cde3 with Priority: HIGHEST for action port [ 716.781685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-557973ee-2947-4987-afbb-a81d7ab1cde3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.781798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-557973ee-2947-4987-afbb-a81d7ab1cde3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.781867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-557973ee-2947-4987-afbb-a81d7ab1cde3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.782360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-557973ee-2947-4987-afbb-a81d7ab1cde3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.782360] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('557973ee-2947-4987-afbb-a81d7ab1cde3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.858141] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc737fb1-ae72-4521-a2d8-98c1cf06601a: rpc.has_security_group_logging(os_id): False [ 716.882851] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.882851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.882851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.883081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.883081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.883247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.883345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.883400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.883558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.883659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.883804] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.883900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.883991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.884117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.884191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.884395] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.884453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.884510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.884648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.884720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.884807] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a is going to be created. [ 716.949347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.949500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.949566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.949789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.949971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.963480] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a in Status: IN_PROGRESS for 2s [ 717.050136] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-49 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.050136] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.050136] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.050136] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.050136] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.050136] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.050438] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.050438] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.050543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.050742] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.050847] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.050949] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.051063] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.051166] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.051264] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.051388] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.088243] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.090268] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.090268] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.090268] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.090268] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-b3106da3-63da-4f31-9a18-dbe391327429 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.090802] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.090802] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.090870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.094036] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3106da3-63da-4f31-9a18-dbe391327429',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.136439] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.246896] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 717.247190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.285365] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 557973ee-2947-4987-afbb-a81d7ab1cde3 [ 717.285675] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.285754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.285822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.286120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.286233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.286339] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:557973ee-2947-4987-afbb-a81d7ab1cde3 already deleted. [ 717.286425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-557973ee-2947-4987-afbb-a81d7ab1cde3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.313652] env[65630]: INFO networking_nsxv3.common.synchronization [req-e4e9db94-b61e-45b2-8958-e50376ed71b8 req-af781a38-e8d0-46b6-9cca-ccd1a22848c6 service nova] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_rules [ 717.313909] env[65630]: INFO networking_nsxv3.common.synchronization [req-e4e9db94-b61e-45b2-8958-e50376ed71b8 req-af781a38-e8d0-46b6-9cca-ccd1a22848c6 service nova] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 717.314063] env[65630]: INFO networking_nsxv3.common.synchronization [req-e4e9db94-b61e-45b2-8958-e50376ed71b8 req-af781a38-e8d0-46b6-9cca-ccd1a22848c6 service nova] Enqueued Resource ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with Priority: HIGHEST for action port [ 717.314797] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_rules [ 717.314951] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 717.315098] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with Priority: HIGHEST for action port [ 717.315386] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.315589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.315589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.315858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.315925] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.317420] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.317583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.317674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.317833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.318395] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.318526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.318594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.318762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.318870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.319345] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.320136] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.320255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.320311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.320469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.320556] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be0978ab-a6bb-4d8a-ad28-02f96e1acd56',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.547161] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: effa588b-c067-4072-96e1-1b9dab231ed7 in Status: SUCCESS [ 717.547508] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: effa588b-c067-4072-96e1-1b9dab231ed7 deletion is rescheduled due to dependency. [ 717.547508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.594305] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.594540] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.594655] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.595346] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.595686] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.595837] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port b3106da3-63da-4f31-9a18-dbe391327429 not found, creating... [ 717.596502] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.597446] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.597446] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.598417] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.598417] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.598701] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.598863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.599265] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.599265] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.599352] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.599470] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: b3106da3-63da-4f31-9a18-dbe391327429 is going to be created. [ 717.623023] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.623273] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.623478] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.623757] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.624121] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.624409] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.639113] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.639984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.641043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.641043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.641043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.641043] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be created. [ 717.669353] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.669652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.669744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.669961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.670273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.683019] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: UNINITIALIZED for 2s [ 717.822574] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with status ACTIVE [ 717.822811] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.822965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.823062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.823287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.823378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.823555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.823655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.823717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.823887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.823996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.824189] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.824349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.824446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.824517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.824627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.824721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 is going to be updated. [ 717.825916] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.826022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.826200] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.851650] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.851819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.851909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.852128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.852335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.852453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.328755] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.333659] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-e20843e9-a23f-4016-873a-4b41aaf4ebb8 service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 718.333753] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-e20843e9-a23f-4016-873a-4b41aaf4ebb8 service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 718.333967] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-e20843e9-a23f-4016-873a-4b41aaf4ebb8 service nova] Enqueued Resource ID: b3106da3-63da-4f31-9a18-dbe391327429 with Priority: HIGHEST for action port [ 718.334853] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 718.335405] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 718.335405] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3106da3-63da-4f31-9a18-dbe391327429 with Priority: HIGHEST for action port [ 718.335578] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.335762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.336330] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.336330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.336643] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3106da3-63da-4f31-9a18-dbe391327429 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.336754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.336929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.337204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.337602] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3106da3-63da-4f31-9a18-dbe391327429',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.833123] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.833859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.833859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.833859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.833859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.834046] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be created. [ 718.840903] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3106da3-63da-4f31-9a18-dbe391327429 with status ACTIVE [ 718.841177] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.841372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.841372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.841997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.841997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.841997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.841997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.841997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.842253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.842253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.842411] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.842863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.842863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.842863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.842863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.842863] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3106da3-63da-4f31-9a18-dbe391327429 is going to be updated. [ 718.867668] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.868032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.868032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.869206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.869206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.872241] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.872832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.872832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.872832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.872832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.874371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3106da3-63da-4f31-9a18-dbe391327429" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.881386] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: UNINITIALIZED for 2s [ 718.979563] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a in Status: SUCCESS [ 718.980677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.219460] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.219460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.219460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.219460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.219460] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.219460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.219460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.219460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.219460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.219801] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.219801] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.219916] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.219998] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.220114] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.220207] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.222075] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.240135] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.240640] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.240841] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.241046] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-561" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.241397] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.241632] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.241990] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.242173] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.242325] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.695036] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 719.695036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.695036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.695036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.695036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.695313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.695313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.695374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.696564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.696564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.696564] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.696956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.697223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.697450] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.697594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.697695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.697930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.698086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.698953] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.745532] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.745761] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.745944] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.746232] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.746415] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.746597] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b not found, creating... [ 719.746879] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.747055] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.747171] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.747397] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.747577] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.747884] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.748075] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.749861] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.749861] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.749861] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.749861] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b is going to be created. [ 719.768925] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.769176] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.769304] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.769567] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.769789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.770026] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.116550] env[65630]: INFO networking_nsxv3.common.synchronization [req-b32d46a8-721a-4726-90e2-38b6c0ce77f5 req-03631188-0dcd-4263-9752-276c6ed00aa5 tempest-ServerAddressesTestJSON-375090076 tempest-ServerAddressesTestJSON-375090076-project-member] Enqueued Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_members [ 720.117093] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_members [ 720.117400] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-313d0c55-f8bb-4559-9f42-dfae7678f0bc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.117680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.117680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.117841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.118037] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.118152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.118275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.118382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.118462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.118555] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.202317] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.202317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.202317] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.474607] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-2be52296-8a93-445b-8176-37d7daa9f79a service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 720.474779] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-2be52296-8a93-445b-8176-37d7daa9f79a service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 720.474914] env[65630]: INFO networking_nsxv3.common.synchronization [req-c31e5ecc-a36f-4247-81f4-8ab9efd21e4b req-2be52296-8a93-445b-8176-37d7daa9f79a service nova] Enqueued Resource ID: d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b with Priority: HIGHEST for action port [ 720.475481] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 720.475619] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 720.475717] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b with Priority: HIGHEST for action port [ 720.476228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.476328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.476516] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.476598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.476768] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.476867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.476928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.477147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.477376] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.622015] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.622202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.622244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.622469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.622576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.622774] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.622876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.622982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.623145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.623224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.623314] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc already deleted. [ 720.623396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.707176] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.865504] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.865723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-109" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.865838] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-109" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.866226] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-109" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.866512] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.866763] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.866887] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.867133] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.867266] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.867482] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.867633] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.867761] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.868085] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.868085] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.868190] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.868254] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.890984] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.891319] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.891765] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.891765] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-109" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.892319] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-6e411102-6b97-4ed6-8ab6-b468fe97b322 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.892595] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.892777] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.893290] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.893433] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e411102-6b97-4ed6-8ab6-b468fe97b322',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.896060] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 720.896060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.896426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.897185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.897185] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.897185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.897185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.897368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.897475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.897562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.897687] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.979410] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b with status ACTIVE [ 720.979705] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.979867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.979955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.980227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.980335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.980538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.980694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.980775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.980967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.981067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.981300] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.981406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.981477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.981664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.981761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.981867] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b is going to be updated. [ 721.006543] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.007057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.007125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.007366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.007549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.007971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7a4a36a-ccb5-4491-9ddc-9cc0d707c63b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.210387] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.210806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.210806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.210884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.211668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.211668] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 721.243629] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.243779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.244153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.244153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.244285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.256234] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 721.403024] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.403024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 6e411102-6b97-4ed6-8ab6-b468fe97b322 not found, creating... [ 721.403024] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.403024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.403478] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.403478] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.403836] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.404188] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.404412] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.404639] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 6e411102-6b97-4ed6-8ab6-b468fe97b322 is going to be created. [ 721.405897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.406165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.406321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.406548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.406787] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.407027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.407172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.407409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.407586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.407754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.407981] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.408200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.408356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.408602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.408831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.409060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.409199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.409430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.409803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.409981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.412465] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.432568] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.432568] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.432568] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.432568] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.432568] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.432568] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.466203] env[65630]: INFO networking_nsxv3.common.synchronization [None req-cf50f97d-c6a3-4b61-83a6-63407c98ce15 None None] Enqueued Resource ID: 780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f with Priority: HIGHEST for action port [ 721.466203] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f with Priority: HIGHEST for action port [ 721.466203] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.466203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.466203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.466203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.466203] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.912136] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b37c50-233f-4cfb-bd1b-645d04b17ca5: rpc.has_security_group_logging(os_id): False [ 721.933814] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.933953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.934034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.934254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.934347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.934534] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.934632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.934698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.934842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.934922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.935111] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.935204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.935257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.935401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.935476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.935699] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.935800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.935862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.936019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.936668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.936819] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be created. [ 721.968175] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f [ 721.968542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.968542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.968646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.968996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.968996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.968996] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f already deleted. [ 721.969109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-780f5ccd-0db1-44f7-8cf5-f9b2c2e1703f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.010069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.010069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.010069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.010069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.010298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.025313] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 722.207478] env[65630]: INFO networking_nsxv3.common.synchronization [req-b32d46a8-721a-4726-90e2-38b6c0ce77f5 req-4292baa0-6386-431a-a591-56f81b071b84 service nova] Enqueued Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_rules [ 722.211420] env[65630]: INFO networking_nsxv3.common.synchronization [req-b32d46a8-721a-4726-90e2-38b6c0ce77f5 req-4292baa0-6386-431a-a591-56f81b071b84 service nova] Enqueued Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_members [ 722.211420] env[65630]: INFO networking_nsxv3.common.synchronization [req-b32d46a8-721a-4726-90e2-38b6c0ce77f5 req-4292baa0-6386-431a-a591-56f81b071b84 service nova] Enqueued Resource ID: 6e411102-6b97-4ed6-8ab6-b468fe97b322 with Priority: HIGHEST for action port [ 722.211420] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_rules [ 722.211420] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_members [ 722.211420] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e411102-6b97-4ed6-8ab6-b468fe97b322 with Priority: HIGHEST for action port [ 722.216868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-313d0c55-f8bb-4559-9f42-dfae7678f0bc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.216868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.216868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.218699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.218699] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.222396] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-313d0c55-f8bb-4559-9f42-dfae7678f0bc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.222396] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.222396] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.222396] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e411102-6b97-4ed6-8ab6-b468fe97b322 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.222396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.222396] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e411102-6b97-4ed6-8ab6-b468fe97b322',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.362726] env[65630]: INFO networking_nsxv3.common.synchronization [req-c727885d-4bbf-4d58-a7fb-d386d44dfd60 req-3a0524b8-04de-4a71-a5cd-896a62e302f2 tempest-SecurityGroupRulesTestJSON-1886688061 tempest-SecurityGroupRulesTestJSON-1886688061-project-member] Enqueued Resource ID: d3c19fa9-7267-4653-a11c-8f2c2a3c9d95 with Priority: HIGHEST for action security_group_rules [ 722.363397] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3c19fa9-7267-4653-a11c-8f2c2a3c9d95 with Priority: HIGHEST for action security_group_rules [ 722.363733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3c19fa9-7267-4653-a11c-8f2c2a3c9d95 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.363856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3c19fa9-7267-4653-a11c-8f2c2a3c9d95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.363909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3c19fa9-7267-4653-a11c-8f2c2a3c9d95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.364409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3c19fa9-7267-4653-a11c-8f2c2a3c9d95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.364556] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3c19fa9-7267-4653-a11c-8f2c2a3c9d95',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.724592] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.725972] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-313d0c55-f8bb-4559-9f42-dfae7678f0bc taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.725972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.726196] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e411102-6b97-4ed6-8ab6-b468fe97b322 with status ACTIVE [ 722.726297] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.726398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.726452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.726671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.726775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.727036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.727200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.727415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.727474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.727592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.727829] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.729128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.729223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.729468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.729903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.729903] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e411102-6b97-4ed6-8ab6-b468fe97b322 is going to be updated. [ 722.755470] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.755668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.755668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.756150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.756150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.756310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e411102-6b97-4ed6-8ab6-b468fe97b322" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.898790] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.899028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.899028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.899288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.899382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.899480] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3c19fa9-7267-4653-a11c-8f2c2a3c9d95 already deleted. [ 722.899614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3c19fa9-7267-4653-a11c-8f2c2a3c9d95" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.232205] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.257257] env[65630]: INFO networking_nsxv3.common.synchronization [req-ba6358f9-39fb-496c-b72d-ce6f3039385a req-6b2a87b1-6721-4a9b-9e92-a2e298ff4721 tempest-ImagesOneServerTestJSON-610554714 tempest-ImagesOneServerTestJSON-610554714-project-member] Enqueued Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_members [ 723.258825] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_members [ 723.259247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.260868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.260967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.261246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.261988] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.262142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.262210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.262383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.262473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.262568] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.272579] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 723.273661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.273661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.273661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.273661] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.273797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.273851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.274011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.274103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.274188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.274350] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.274427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.274486] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.274626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.274763] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.274854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.274914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.275194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.275912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.275912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.275912] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.276889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.277120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.277287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.277389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.277452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.277602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.277685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.277768] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.737838] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.737838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.738018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.738152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.738432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.738432] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc is going to be created. [ 723.763487] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.763645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.763717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.763934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.764114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.765366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.765590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.765590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.765718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.765804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.765980] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.766418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.766505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.766703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.766843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.766964] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d already deleted. [ 723.767088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.777533] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc in Status: UNINITIALIZED for 2s [ 723.779483] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 250f01a9-6e9d-4438-a22e-10b77875cd34: rpc.has_security_group_logging(os_id): False [ 723.780471] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.801939] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.802706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.802834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.803124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.803442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.805852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.805852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.805852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.806061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.806061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.806296] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.807037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.807126] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.807325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.807510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.807621] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.807721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.807793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.807943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.808037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.808130] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be created. [ 723.874793] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.875186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.875186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.875496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.875789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.892017] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 724.040417] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 724.040704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.123817] env[65630]: INFO networking_nsxv3.common.synchronization [None req-37bc48ba-7e53-4d8f-aa2b-9e050e959d6d None None] Enqueued Resource ID: 5ac1a03d-feab-4987-8d3d-b556a4ef1449 with Priority: HIGHEST for action port [ 724.125228] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac1a03d-feab-4987-8d3d-b556a4ef1449 with Priority: HIGHEST for action port [ 724.125228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ac1a03d-feab-4987-8d3d-b556a4ef1449 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.125228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ac1a03d-feab-4987-8d3d-b556a4ef1449" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.125228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ac1a03d-feab-4987-8d3d-b556a4ef1449" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.125228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ac1a03d-feab-4987-8d3d-b556a4ef1449" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.125228] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ac1a03d-feab-4987-8d3d-b556a4ef1449',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.267370] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-143 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.267370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-143" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.267370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-143" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.267370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-143" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.267370] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.267370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.267370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.267370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.267370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.267370] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.267370] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.267370] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.267370] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.268051] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.268051] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.268051] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.282752] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.288451] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.288451] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.288451] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.288451] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-143" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.288451] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.288451] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.288451] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.288451] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.288451] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('248eaf55-5b69-4c07-9cc6-07d7e8cf813b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.630633] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ac1a03d-feab-4987-8d3d-b556a4ef1449 [ 724.630982] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.631084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.631120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.631721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.631721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.631721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ac1a03d-feab-4987-8d3d-b556a4ef1449 already deleted. [ 724.631903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ac1a03d-feab-4987-8d3d-b556a4ef1449" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.785260] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.785368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.785438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.785656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.785752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.785842] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 724.790976] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.791194] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.791307] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.791553] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.791706] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.791845] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 248eaf55-5b69-4c07-9cc6-07d7e8cf813b not found, creating... [ 724.792116] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.792262] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.792368] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.792574] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.792698] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.792982] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.793152] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.793257] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.793451] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.793570] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.793702] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 248eaf55-5b69-4c07-9cc6-07d7e8cf813b is going to be created. [ 724.820247] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.820462] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.820581] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.821374] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.821374] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.821494] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.834939] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.834939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.835061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.835301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.835536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.850965] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 725.585814] env[65630]: INFO networking_nsxv3.common.synchronization [req-ba6358f9-39fb-496c-b72d-ce6f3039385a req-298962c5-4459-4189-bcc5-3f2df6d53493 service nova] Enqueued Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_rules [ 725.585814] env[65630]: INFO networking_nsxv3.common.synchronization [req-ba6358f9-39fb-496c-b72d-ce6f3039385a req-298962c5-4459-4189-bcc5-3f2df6d53493 service nova] Enqueued Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_members [ 725.585814] env[65630]: INFO networking_nsxv3.common.synchronization [req-ba6358f9-39fb-496c-b72d-ce6f3039385a req-298962c5-4459-4189-bcc5-3f2df6d53493 service nova] Enqueued Resource ID: 248eaf55-5b69-4c07-9cc6-07d7e8cf813b with Priority: HIGHEST for action port [ 725.589736] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_rules [ 725.589736] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_members [ 725.589736] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 248eaf55-5b69-4c07-9cc6-07d7e8cf813b with Priority: HIGHEST for action port [ 725.589736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.589736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.589736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.589736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.589736] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.590636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.590636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.590636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.590636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.590636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.590636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.591090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.591090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.591090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.591090] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.592136] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.592255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.592320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.593028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.593101] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('248eaf55-5b69-4c07-9cc6-07d7e8cf813b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.670138] env[65630]: INFO networking_nsxv3.common.synchronization [None req-f8c6d912-57dd-4a3e-947c-01aa1fee711b tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 725.671292] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 725.671731] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.673918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.673918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.673918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.673918] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.793474] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc in Status: SUCCESS [ 725.793692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.793833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.794059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.794258] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.794377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.795043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.795043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.795043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.795043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.795043] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.909349] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 725.909628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.909870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.910465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.910465] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.942382] env[65630]: INFO networking_nsxv3.common.synchronization [None req-651c7302-76be-4060-bbaa-5fbd1b90bcd0 tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 725.942382] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 725.942382] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.943759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.096116] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.096840] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.096960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.097378] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 248eaf55-5b69-4c07-9cc6-07d7e8cf813b with status ACTIVE [ 726.097663] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.097663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.097814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.097975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.099994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.100244] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.100374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.100443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.100706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.100809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.101046] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.101162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.101231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.101618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.101618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.101618] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 248eaf55-5b69-4c07-9cc6-07d7e8cf813b is going to be updated. [ 726.139031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.139266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.139266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.139506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.139669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.140081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-248eaf55-5b69-4c07-9cc6-07d7e8cf813b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.195343] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.195571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.195614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.195878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.195992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.196125] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 already deleted. [ 726.196256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.196457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.196687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.196819] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.301027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-313d0c55-f8bb-4559-9f42-dfae7678f0bc taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.301027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.301027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-313d0c55-f8bb-4559-9f42-dfae7678f0bc taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.301027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.301027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.301767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.301767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.301767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.301767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.301767] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.415521] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.415876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.598222] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.716952] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.717122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.717193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.717715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.717715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.717715] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 already deleted. [ 726.717715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.805929] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 313d0c55-f8bb-4559-9f42-dfae7678f0bc: rpc.has_security_group_logging(os_id): False [ 726.823998] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.825666] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.825666] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.825666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.826149] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.826149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.826149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.827996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.828199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.828542] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc is going to be created. [ 726.861436] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 726.861436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.861436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.861731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.862801] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.862801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.862801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.862801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.862801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.862801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.862801] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.897335] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.897486] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.897548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.897772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.897982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.911083] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc in Status: IN_PROGRESS for 2s [ 727.101634] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.103088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.103088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.103088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.103088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.103088] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d is going to be created. [ 727.153181] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.153382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.153503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.153831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.154033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.166687] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d in Status: UNINITIALIZED for 2s [ 727.364932] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.365135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.365203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.365468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.365644] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.365772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.365834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.365997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.366103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.366209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.366414] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.366483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.366530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.366717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.366818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.366911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.366968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.367147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.369253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.369440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.369608] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.873615] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 250f01a9-6e9d-4438-a22e-10b77875cd34: rpc.has_security_group_logging(os_id): False [ 727.902330] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.902571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.902571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.902740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.904322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.904322] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.904322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.905322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.905322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.905453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.905896] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.906065] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.906580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.907043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.907130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.907646] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.907646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.907646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.907873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.907873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.910914] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 728.011817] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.011817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.011817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.012114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.013019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.036260] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 728.590514] env[65630]: INFO networking_nsxv3.common.synchronization [req-aa6d8956-5209-4fea-84c5-5072cabe799b req-5e7b0149-f401-4c25-a27d-1c75ac529ba3 tempest-FloatingIPsAssociationTestJSON-476441825 tempest-FloatingIPsAssociationTestJSON-476441825-project-member] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 728.591288] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 728.591680] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.591852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.591962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.592232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.592425] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.592591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.592690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.593074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.593198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.593349] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.925602] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc in Status: SUCCESS [ 728.925602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.096738] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.178620] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d in Status: SUCCESS [ 729.179236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.180012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.180575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.180984] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.181307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.181504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.181875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.182114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.182469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.182717] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.599891] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.685229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.685946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.685946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.686097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.686164] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.686277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.686337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.686514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.686609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.686682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.688138] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.688138] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.688138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.688138] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.847233] env[65630]: INFO networking_nsxv3.common.synchronization [req-9eb444ab-3a73-4c13-a6c0-b68b52e98c3e req-6c6622d9-bff5-4dfb-bf8e-16dde2277867 tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_members [ 729.848157] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_members [ 729.849202] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.849645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.851031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.851031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.851031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.851031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.851031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.852039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.854414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.854414] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.050981] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 730.051876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.052218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.054033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.054033] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.101996] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.102168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.102241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.102477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.102565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.102664] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 is going to be updated. [ 730.142225] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.142534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.142663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.142980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.143158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.158084] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: IN_PROGRESS for 2s [ 730.195648] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d: rpc.has_security_group_logging(os_id): False [ 730.218586] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.218586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.218586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.219749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.219749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.219749] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.219749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.219749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.221414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.221414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.221414] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.221414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.225077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.225077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.225077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.225077] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.225077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.225077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.225077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.225077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.225077] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d is going to be created. [ 730.301233] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.301903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.301903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.301903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.302105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.319959] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d in Status: IN_PROGRESS for 2s [ 730.356542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.357240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.357387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.358019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.358019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.358019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.358210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.358210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.358293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.358361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.358468] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b already deleted. [ 730.358643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.493357] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-124 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.493687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.493687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.494056] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.496180] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.496180] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.496180] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.496381] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.496381] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.497355] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.497355] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.497355] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.497558] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.497840] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.497914] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.498033] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.518634] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.521391] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.521391] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.521391] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.521391] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.521391] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.521391] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.521734] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.522152] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd7fd9b7-a28f-42a3-ae79-af295655e9d2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.557053] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.557053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.557053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.557669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.557669] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.557669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.557669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.557937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.557937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.558082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.558131] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.025680] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.025915] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.026045] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.026404] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.026535] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.026702] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port dd7fd9b7-a28f-42a3-ae79-af295655e9d2 not found, creating... [ 731.026973] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.027148] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.027260] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.027486] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.027619] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.027990] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.028075] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.028211] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.028438] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.028598] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.028774] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: dd7fd9b7-a28f-42a3-ae79-af295655e9d2 is going to be created. [ 731.050031] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.050258] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.050371] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.050641] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.050928] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.051171] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.061292] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.061292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.061292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.061519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.061722] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.061829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.061892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.062066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.062157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.062248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.062421] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.062513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.062572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.062720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.062857] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.062946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.063012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.063200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.063278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.063359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.063447] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.566717] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 250f01a9-6e9d-4438-a22e-10b77875cd34: rpc.has_security_group_logging(os_id): False [ 731.598267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.598455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.598587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.598996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.599073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.600119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.600119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.600119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.600119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.600119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.600934] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.601014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.601219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.601460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.601596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.602031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.602183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.602183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.602401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.602580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.602634] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 731.725450] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.725636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.725683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.725971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.726032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.743640] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 731.914850] env[65630]: INFO networking_nsxv3.common.synchronization [req-9eb444ab-3a73-4c13-a6c0-b68b52e98c3e req-1ada039d-8d58-4155-9c25-a43463161d8f service nova] Enqueued Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_rules [ 731.914991] env[65630]: INFO networking_nsxv3.common.synchronization [req-9eb444ab-3a73-4c13-a6c0-b68b52e98c3e req-1ada039d-8d58-4155-9c25-a43463161d8f service nova] Enqueued Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_members [ 731.915136] env[65630]: INFO networking_nsxv3.common.synchronization [req-9eb444ab-3a73-4c13-a6c0-b68b52e98c3e req-1ada039d-8d58-4155-9c25-a43463161d8f service nova] Enqueued Resource ID: dd7fd9b7-a28f-42a3-ae79-af295655e9d2 with Priority: HIGHEST for action port [ 731.915371] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_rules [ 731.915517] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_members [ 731.915615] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd7fd9b7-a28f-42a3-ae79-af295655e9d2 with Priority: HIGHEST for action port [ 731.916208] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.916363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.916415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.916695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.916695] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.919932] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.919932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.919932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.920136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.920734] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.921351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.921439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.921613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.921719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.922595] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.923038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.923152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.923217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.923379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.923458] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd7fd9b7-a28f-42a3-ae79-af295655e9d2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.169535] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: SUCCESS [ 732.170385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.336405] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d in Status: SUCCESS [ 732.336805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.425418] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.425590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.425920] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.427234] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd7fd9b7-a28f-42a3-ae79-af295655e9d2 with status ACTIVE [ 732.428272] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.428272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.428272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.428272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.428272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.430324] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.430522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.430601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.430857] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.430954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.431447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.431447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.431447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.431562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.431599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.431729] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd7fd9b7-a28f-42a3-ae79-af295655e9d2 is going to be updated. [ 732.469953] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.469953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.469953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.469953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.470198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.470198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd7fd9b7-a28f-42a3-ae79-af295655e9d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.937012] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.439249] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.439728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.439728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.439848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.439982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.440133] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b is going to be created. [ 733.469201] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.469201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.469201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.470957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.471259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.481206] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b in Status: UNINITIALIZED for 2s [ 733.760325] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 733.760563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.107551] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b22890fd-daed-42d2-b2bb-6738d1240e32 None None] Enqueued Resource ID: f115bce3-1850-49d9-a51d-4f070d84cd7b with Priority: HIGHEST for action port [ 734.109267] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f115bce3-1850-49d9-a51d-4f070d84cd7b with Priority: HIGHEST for action port [ 734.110078] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f115bce3-1850-49d9-a51d-4f070d84cd7b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.110239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f115bce3-1850-49d9-a51d-4f070d84cd7b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.110356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f115bce3-1850-49d9-a51d-4f070d84cd7b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.110817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f115bce3-1850-49d9-a51d-4f070d84cd7b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.111069] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f115bce3-1850-49d9-a51d-4f070d84cd7b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.618524] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f115bce3-1850-49d9-a51d-4f070d84cd7b [ 734.620109] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.620109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.620109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.620109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.620109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.620109] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f115bce3-1850-49d9-a51d-4f070d84cd7b already deleted. [ 734.620109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f115bce3-1850-49d9-a51d-4f070d84cd7b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.034494] env[65630]: INFO networking_nsxv3.common.synchronization [req-fc276b5a-c718-41ee-a606-6958638a4b33 req-db6ac9b5-1bc4-48f1-8cae-95d0d74a719f tempest-SecurityGroupRulesTestJSON-1886688061 tempest-SecurityGroupRulesTestJSON-1886688061-project-member] Enqueued Resource ID: c6cebc2a-8af3-44bd-984f-1c2cfd726efe with Priority: HIGHEST for action security_group_rules [ 735.037145] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cebc2a-8af3-44bd-984f-1c2cfd726efe with Priority: HIGHEST for action security_group_rules [ 735.037736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6cebc2a-8af3-44bd-984f-1c2cfd726efe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.037903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6cebc2a-8af3-44bd-984f-1c2cfd726efe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.037942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6cebc2a-8af3-44bd-984f-1c2cfd726efe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.038458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6cebc2a-8af3-44bd-984f-1c2cfd726efe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.038458] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6cebc2a-8af3-44bd-984f-1c2cfd726efe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.494422] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b in Status: SUCCESS [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.494422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.494422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.494422] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.563034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.563227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.563227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.563387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.563502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.563601] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6cebc2a-8af3-44bd-984f-1c2cfd726efe already deleted. [ 735.563683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6cebc2a-8af3-44bd-984f-1c2cfd726efe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.967238] env[65630]: INFO networking_nsxv3.common.synchronization [None req-cd52c504-b9ad-453c-b341-3a2895c27f81 tempest-ServerActionsV293TestJSON-1369746759 tempest-ServerActionsV293TestJSON-1369746759-project-member] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_rules [ 735.967924] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_rules [ 735.968250] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.968372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.968438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.968706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.968798] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.996372] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.165435] env[65630]: INFO networking_nsxv3.common.synchronization [None req-26e9b80c-e0e4-445a-a03c-7400f472fa5f tempest-ServerActionsV293TestJSON-1369746759 tempest-ServerActionsV293TestJSON-1369746759-project-member] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_rules [ 736.165842] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_rules [ 736.166911] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.166911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.280220] env[65630]: INFO networking_nsxv3.common.synchronization [req-36910a91-7cb8-473b-a01d-4a3c0e8b088e req-84e462c7-45e3-4e20-bffc-6d8645a4be7d tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 736.280769] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 736.281089] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.281457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.281457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.281457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.281636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.281757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.281830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.281988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.282093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.282165] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.491469] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.493311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.493311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.493311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.493311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.493311] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c already deleted. [ 736.493311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.493311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.493311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.493311] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.498653] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2ce74e6-0ec2-49a0-a447-71132c9e529b: rpc.has_security_group_logging(os_id): False [ 736.518425] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.521021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.521021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.521021] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b is going to be created. [ 736.586605] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.586761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.586834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.587057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.587238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.600749] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b in Status: IN_PROGRESS for 2s [ 736.688573] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-492 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.689048] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.689048] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.689562] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.693971] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.693971] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.693971] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.693971] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.693971] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.694280] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.694362] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.694495] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.694633] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.694792] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.694906] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.695180] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.719265] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.719265] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.719265] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.719406] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-492" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.719655] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-c98c0310-2eeb-46e3-938d-6549f9ce3579 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.719818] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.719928] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.720367] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.720501] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c98c0310-2eeb-46e3-938d-6549f9ce3579',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.785234] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.866990] env[65630]: INFO networking_nsxv3.common.synchronization [None req-d8b051cc-3c7a-4320-9d1a-4a459ad02e0b None None] Enqueued Resource ID: b53472ee-6091-4c30-93b0-7ae674f7eb74 with Priority: HIGHEST for action port [ 736.868131] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b53472ee-6091-4c30-93b0-7ae674f7eb74 with Priority: HIGHEST for action port [ 736.869049] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b53472ee-6091-4c30-93b0-7ae674f7eb74 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.870941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b53472ee-6091-4c30-93b0-7ae674f7eb74" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.870941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b53472ee-6091-4c30-93b0-7ae674f7eb74" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.870941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b53472ee-6091-4c30-93b0-7ae674f7eb74" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.870941] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b53472ee-6091-4c30-93b0-7ae674f7eb74',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.017795] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.018130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.018172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.018938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.018938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.018938] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c already deleted. [ 737.018938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.223649] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.223899] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.224084] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.224434] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.224625] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.224794] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port c98c0310-2eeb-46e3-938d-6549f9ce3579 not found, creating... [ 737.225129] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.225952] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.226155] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.226395] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.226539] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.226828] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.226988] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.227176] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.227384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.227698] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.227839] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: c98c0310-2eeb-46e3-938d-6549f9ce3579 is going to be created. [ 737.249264] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.249495] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.249615] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.249883] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.250126] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.251199] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.287422] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.375612] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b53472ee-6091-4c30-93b0-7ae674f7eb74 [ 737.375845] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.375988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.376075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.376333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.376433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.376526] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b53472ee-6091-4c30-93b0-7ae674f7eb74 already deleted. [ 737.376609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b53472ee-6091-4c30-93b0-7ae674f7eb74" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.791175] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.791175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.791175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.791569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.791569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.791569] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 737.831354] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.831842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.831842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.831842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.831842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.844122] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 738.062138] env[65630]: INFO networking_nsxv3.common.synchronization [req-36910a91-7cb8-473b-a01d-4a3c0e8b088e req-88dabd48-baaa-44ec-abbc-be425785856c service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 738.062138] env[65630]: INFO networking_nsxv3.common.synchronization [req-36910a91-7cb8-473b-a01d-4a3c0e8b088e req-88dabd48-baaa-44ec-abbc-be425785856c service nova] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 738.062138] env[65630]: INFO networking_nsxv3.common.synchronization [req-36910a91-7cb8-473b-a01d-4a3c0e8b088e req-88dabd48-baaa-44ec-abbc-be425785856c service nova] Enqueued Resource ID: c98c0310-2eeb-46e3-938d-6549f9ce3579 with Priority: HIGHEST for action port [ 738.062138] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_rules [ 738.062138] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 738.062138] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98c0310-2eeb-46e3-938d-6549f9ce3579 with Priority: HIGHEST for action port [ 738.063319] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.063581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.063761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.065063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.065324] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.069307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.069307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.069307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c98c0310-2eeb-46e3-938d-6549f9ce3579 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.069307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.069307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.070273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.070273] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c98c0310-2eeb-46e3-938d-6549f9ce3579',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.574422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.574422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.574422] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c98c0310-2eeb-46e3-938d-6549f9ce3579 with status ACTIVE [ 738.574422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.574422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.574422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.574422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.574422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.574422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.575173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.575173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.575173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.575173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.575294] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.575356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.575410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.575550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.575752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.575844] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c98c0310-2eeb-46e3-938d-6549f9ce3579 is going to be updated. [ 738.607690] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.608932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.608932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.609270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.610767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.610767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c98c0310-2eeb-46e3-938d-6549f9ce3579" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.615801] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b in Status: SUCCESS [ 738.615801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.861276] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 739.861696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.861853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.862108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.862333] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.862497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.862569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.862826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.862944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.862998] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.367576] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.782660] env[65630]: INFO networking_nsxv3.common.synchronization [req-dd90bf71-5d53-4438-bdc0-746497267a84 req-89b0682c-f2a6-424d-b579-c0a48523bcc7 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 740.783259] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 740.783548] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.783674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.783742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.783951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.787396] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.787396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.787396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.787396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.787396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.787396] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.871477] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.075841] env[65630]: INFO networking_nsxv3.common.synchronization [req-dd90bf71-5d53-4438-bdc0-746497267a84 req-4aa11954-c08e-4238-acd0-521ea4aa90d4 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 741.076487] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 741.076821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.077238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.287441] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.340379] env[65630]: INFO networking_nsxv3.common.synchronization [req-dd90bf71-5d53-4438-bdc0-746497267a84 req-66cd5d74-4775-4bf0-812d-578d153ed689 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 741.342733] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 741.343413] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.343511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.376950] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.377133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.377582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.377582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.377582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.377723] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 741.414893] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.415723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.415723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.415723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.415723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.425328] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 741.768413] env[65630]: INFO networking_nsxv3.common.synchronization [req-8dee35f6-5394-425c-a6cd-39d609eb487d req-6eea9ed5-00d4-458d-9359-00adab9788b8 tempest-ServerAddressesNegativeTestJSON-658209887 tempest-ServerAddressesNegativeTestJSON-658209887-project-member] Enqueued Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_members [ 741.769068] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_members [ 741.769588] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.769739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.769810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.770265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.770456] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.770562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.770638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.770904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.771121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.771283] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.791933] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.158858] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.159201] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-938" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.159392] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-938" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.159711] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-938" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.160321] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.161127] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.161349] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.161633] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.161891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.162196] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.162447] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.162510] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.162662] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.162815] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.162993] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.163233] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.183644] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.183854] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.184103] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.184377] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-938" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.184844] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-a5d67351-6f93-4887-98f3-79877a8afc33 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.185361] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.185964] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.186276] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.186562] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5d67351-6f93-4887-98f3-79877a8afc33',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.273877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.274423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.274423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.274423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.274581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.274670] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.274818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.274885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.275063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.275184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.275251] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd already deleted. [ 742.275339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.294127] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.294339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.294422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.294652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.294771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.295758] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 742.328456] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.328605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.328678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.329050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.330231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.345377] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 742.690024] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.690024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.690024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.690024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.690024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.690352] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port a5d67351-6f93-4887-98f3-79877a8afc33 not found, creating... [ 742.690452] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.690620] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.690806] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.691103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.691243] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691673] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.691923] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.692244] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.692530] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.694051] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.694051] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: a5d67351-6f93-4887-98f3-79877a8afc33 is going to be created. [ 742.722560] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.722754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.722879] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.723120] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.723343] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.723563] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.437900] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 743.438347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.438516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.438749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.438980] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.439128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.439217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.439416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.439505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.439596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.439689] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.460736] env[65630]: INFO networking_nsxv3.common.synchronization [req-5da353c1-79cc-45c7-a655-2daee71ad59b req-72efd60f-475b-40e2-8766-40a59b28f939 tempest-SecurityGroupRulesTestJSON-1886688061 tempest-SecurityGroupRulesTestJSON-1886688061-project-member] Enqueued Resource ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 with Priority: HIGHEST for action security_group_rules [ 743.461446] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 with Priority: HIGHEST for action security_group_rules [ 743.462034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d33e6ecd-9d7a-45b6-af79-d24cba078722 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.462034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.462200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.462551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.462803] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d33e6ecd-9d7a-45b6-af79-d24cba078722',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.665251] env[65630]: INFO networking_nsxv3.common.synchronization [req-8dee35f6-5394-425c-a6cd-39d609eb487d req-4fd13bcc-07d4-4e30-ba3a-4b74fafbff64 service nova] Enqueued Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_rules [ 743.665425] env[65630]: INFO networking_nsxv3.common.synchronization [req-8dee35f6-5394-425c-a6cd-39d609eb487d req-4fd13bcc-07d4-4e30-ba3a-4b74fafbff64 service nova] Enqueued Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_members [ 743.665552] env[65630]: INFO networking_nsxv3.common.synchronization [req-8dee35f6-5394-425c-a6cd-39d609eb487d req-4fd13bcc-07d4-4e30-ba3a-4b74fafbff64 service nova] Enqueued Resource ID: a5d67351-6f93-4887-98f3-79877a8afc33 with Priority: HIGHEST for action port [ 743.666248] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_rules [ 743.667090] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_members [ 743.667090] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5d67351-6f93-4887-98f3-79877a8afc33 with Priority: HIGHEST for action port [ 743.667090] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.667090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.667536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.667536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.667739] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.668657] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.668895] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.669042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.669372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.669372] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.669636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.669636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.673884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.673884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.673884] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.675433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5d67351-6f93-4887-98f3-79877a8afc33 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.675588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.675588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.675983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.675983] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5d67351-6f93-4887-98f3-79877a8afc33',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.942134] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.942294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.942367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.942586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.942756] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.942858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.942924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.943213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.943213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.943308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.943427] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.943519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.943631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.943717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.943855] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.943949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.944024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.944162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.944229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.944354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.944519] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.987612] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.988636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.988636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.988636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.988854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.988889] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 already deleted. [ 743.990041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.179084] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.179084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.179084] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.180525] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5d67351-6f93-4887-98f3-79877a8afc33 with status ACTIVE [ 744.180709] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.180841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.181358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.181496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.181496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.181675] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.181803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.181903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.182068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.182154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.183910] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.183910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.183910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.183910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.183910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.183910] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5d67351-6f93-4887-98f3-79877a8afc33 is going to be updated. [ 744.209498] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.209637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.209698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.209930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.210205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.210302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5d67351-6f93-4887-98f3-79877a8afc33" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.357730] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 744.357730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.357730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.358052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.358052] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.358381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.358457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.358653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.358805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.358897] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.448850] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e647f36-5543-4052-8cd2-b972c5bc69c3: rpc.has_security_group_logging(os_id): False [ 744.472750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.473064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.473064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.473262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.473339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.473558] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.473712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.474162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.474162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.474162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.474477] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.474582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.474650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.474788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.475399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.476429] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.476552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.476626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.476824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.476901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.477011] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 744.555656] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.555827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.555908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.556193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.556383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.574121] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 744.686020] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.861041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.861236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.861362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.861625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.861776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.863053] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.863053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.863053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.863053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.863053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.863053] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 744.908242] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.908515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.908692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.909071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.909327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.922997] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 745.188671] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.189175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.189175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.189917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.189917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.189917] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd is going to be created. [ 745.217309] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.217508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.217508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.217710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.218052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.232396] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd in Status: UNINITIALIZED for 2s [ 745.382710] env[65630]: INFO networking_nsxv3.common.synchronization [req-b5a63def-a523-4bcf-ae2d-82a0cb61b4a2 req-bbb350fb-bcf1-410d-903b-978c8ce4f5e6 tempest-SecurityGroupRulesTestJSON-1886688061 tempest-SecurityGroupRulesTestJSON-1886688061-project-member] Enqueued Resource ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 with Priority: HIGHEST for action security_group_rules [ 745.383311] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 with Priority: HIGHEST for action security_group_rules [ 745.383626] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d33e6ecd-9d7a-45b6-af79-d24cba078722 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.383751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.383820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.385197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.385278] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d33e6ecd-9d7a-45b6-af79-d24cba078722',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.429355] env[65630]: INFO networking_nsxv3.common.synchronization [req-891ee21a-60bc-48f8-a7fe-4251d809abe3 req-0472f140-3ac9-4cc8-b68b-6cac691f4381 tempest-ServerAddressesTestJSON-375090076 tempest-ServerAddressesTestJSON-375090076-project-member] Enqueued Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_members [ 745.429952] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc with Priority: HIGHEST for action security_group_members [ 745.431306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-313d0c55-f8bb-4559-9f42-dfae7678f0bc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.433788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.433788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.433788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.433788] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.433788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.433788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.433788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.433788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.433788] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('313d0c55-f8bb-4559-9f42-dfae7678f0bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.917127] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.917127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.917127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.917127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.917127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.917127] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 already deleted. [ 745.917127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.937996] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.938229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.938365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.938733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.941543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.942231] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.942394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.942461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.944063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.944172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.944282] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc is going to be updated. [ 745.985466] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.985753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.985817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.986097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.986305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.997515] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc in Status: IN_PROGRESS for 2s [ 746.592734] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 746.593084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.817136] env[65630]: INFO networking_nsxv3.common.synchronization [req-eb3ea81c-561b-4b0b-8796-72962d0fa1e4 req-27797370-2e8f-4e0e-b638-a69ad6c2b27c tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 746.818044] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 746.818390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.818590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.818590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.821937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.821937] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.821937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.821937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.821937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.821937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.821937] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.933226] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 746.933471] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 deletion is rescheduled due to dependency. [ 746.933519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.933682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.933921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.934179] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.934324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.934431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.934684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.934821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.934930] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.244248] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd in Status: SUCCESS [ 747.244494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.244659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.244876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.245184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.245308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.245371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.245532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.245609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.245690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.245776] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.325138] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.325459] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.326157] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.326576] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.328288] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.328288] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.328288] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.328288] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.328288] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.328288] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.328288] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.328288] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.328634] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.328634] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.328759] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.328912] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.331351] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.331483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.333137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.333137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.333137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.333137] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.333137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.334234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.337277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.339841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.339841] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 already deleted. [ 747.339841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.370253] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.370253] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.370253] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.370253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.370253] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-38988061-526a-4665-86c5-a7d8953ecfc1 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.370253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.370253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.370253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.371617] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38988061-526a-4665-86c5-a7d8953ecfc1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.440542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.440542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.440542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.440743] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.440920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.441150] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.441245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.441310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.441480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.441559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.441648] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 747.473942] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.474218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.474321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.474614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.475668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.494249] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 747.748718] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.748929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.749040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.749303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.752125] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.752277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.752395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.752597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.752698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.752780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.752945] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.753080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.753139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.753452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.753452] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.753593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.753593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.753917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.753917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.753917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.754189] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.876778] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.876778] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.876778] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.876778] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.876778] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.876778] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 38988061-526a-4665-86c5-a7d8953ecfc1 not found, creating... [ 747.876778] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.877565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.877565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.877565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.877565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.878015] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.878015] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.878434] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.878434] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.879132] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.879132] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 38988061-526a-4665-86c5-a7d8953ecfc1 is going to be created. [ 747.902601] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.904424] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.904424] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.904424] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.904424] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.904424] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.023534] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc in Status: SUCCESS [ 748.023887] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 313d0c55-f8bb-4559-9f42-dfae7678f0bc deletion is rescheduled due to dependency. [ 748.024418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-313d0c55-f8bb-4559-9f42-dfae7678f0bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.257564] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55a976b-1ec3-494a-b8f8-938b05f19fbd: rpc.has_security_group_logging(os_id): False [ 748.276675] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.276860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.276949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.277234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.277349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.277566] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.277696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.277772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.277954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.278054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.278288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.278402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.278492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.278669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.278761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.279028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.279874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.279986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.280359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.280525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.280657] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd is going to be created. [ 748.351611] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.351813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.351855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.352141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.352310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.371196] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd in Status: IN_PROGRESS for 2s [ 748.688731] env[65630]: INFO networking_nsxv3.common.synchronization [req-eb3ea81c-561b-4b0b-8796-72962d0fa1e4 req-671c9d81-9991-41ca-96b5-399a90398ea7 service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 748.689270] env[65630]: INFO networking_nsxv3.common.synchronization [req-eb3ea81c-561b-4b0b-8796-72962d0fa1e4 req-671c9d81-9991-41ca-96b5-399a90398ea7 service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 748.689547] env[65630]: INFO networking_nsxv3.common.synchronization [req-eb3ea81c-561b-4b0b-8796-72962d0fa1e4 req-671c9d81-9991-41ca-96b5-399a90398ea7 service nova] Enqueued Resource ID: 38988061-526a-4665-86c5-a7d8953ecfc1 with Priority: HIGHEST for action port [ 748.690256] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 748.690477] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 748.690683] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38988061-526a-4665-86c5-a7d8953ecfc1 with Priority: HIGHEST for action port [ 748.691132] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.691413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.691549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.691854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.691969] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.693518] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.693824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.693932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.694239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.694390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.694507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.694588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.694796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.694905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.695041] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.697045] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-38988061-526a-4665-86c5-a7d8953ecfc1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.697220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.697309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.697524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.697667] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38988061-526a-4665-86c5-a7d8953ecfc1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.203567] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38988061-526a-4665-86c5-a7d8953ecfc1 with status ACTIVE [ 749.204256] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.204256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.204256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.204256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.204256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.204512] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.204512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.204512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.204664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.204712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.204865] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.204955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.205036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.205180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.205255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.205319] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38988061-526a-4665-86c5-a7d8953ecfc1 is going to be updated. [ 749.207357] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.207542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.207687] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.231447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.231700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.231700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.231879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.232050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.232245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38988061-526a-4665-86c5-a7d8953ecfc1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.513041] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 749.513041] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 deletion is rescheduled due to dependency. [ 749.513041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.710266] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.762063] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9cf77284-05ec-46b5-a751-feff43aedff4 None None] Enqueued Resource ID: ac9464c9-52cc-4d9b-b97f-388dacb16496 with Priority: HIGHEST for action port [ 749.764032] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9464c9-52cc-4d9b-b97f-388dacb16496 with Priority: HIGHEST for action port [ 749.764032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac9464c9-52cc-4d9b-b97f-388dacb16496 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.764032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac9464c9-52cc-4d9b-b97f-388dacb16496" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.764032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac9464c9-52cc-4d9b-b97f-388dacb16496" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.764269] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac9464c9-52cc-4d9b-b97f-388dacb16496" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.764269] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac9464c9-52cc-4d9b-b97f-388dacb16496',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.213782] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.214217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.214217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.214217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.214464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.214464] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be created. [ 750.244038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.244523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.244650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.244906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.245094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.257660] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: UNINITIALIZED for 2s [ 750.266237] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac9464c9-52cc-4d9b-b97f-388dacb16496 [ 750.266553] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.266716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.266783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.267042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.267141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.267240] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac9464c9-52cc-4d9b-b97f-388dacb16496 already deleted. [ 750.267323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac9464c9-52cc-4d9b-b97f-388dacb16496" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.356606] env[65630]: INFO networking_nsxv3.common.synchronization [req-fce60b80-1ec2-451f-84ce-d5b27f306a7d req-29abf2d1-605d-4838-b76f-5d8238d06645 tempest-ListServerFiltersTestJSON-678265133 tempest-ListServerFiltersTestJSON-678265133-project-member] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 750.357390] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 750.357849] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.357985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.358069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.358350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.358527] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.358639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.358709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.358949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.359069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.359179] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.386867] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd in Status: SUCCESS [ 750.387178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.861789] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.861986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.862264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.862298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.862385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.862591] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.862696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.862748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.862904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.862981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.863087] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c already deleted. [ 750.863171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.150403] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.150599] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.150716] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.151169] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.151443] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.151655] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.151864] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.152948] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.154315] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.154587] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.154738] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.154870] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.155009] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.155174] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.155336] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.155502] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.188530] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.188649] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.188714] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.188970] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.189338] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-f8fe3de0-8aec-4886-9830-c7262a061073 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.189525] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.189637] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.189954] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.191026] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8fe3de0-8aec-4886-9830-c7262a061073',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.694474] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.694474] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.694474] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.694944] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.694944] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.694944] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port f8fe3de0-8aec-4886-9830-c7262a061073 not found, creating... [ 751.695253] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.695423] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.695593] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.695773] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.695919] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.696463] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.696646] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.696765] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.696977] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.697123] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.697257] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: f8fe3de0-8aec-4886-9830-c7262a061073 is going to be created. [ 751.723657] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.723995] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.724085] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.724341] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.724957] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.724957] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.030460] env[65630]: INFO networking_nsxv3.common.synchronization [None req-cde3eab1-6da8-4947-9642-1306b8284e8e None None] Enqueued Resource ID: c92304b4-2415-49fc-8605-3f067e055b96 with Priority: HIGHEST for action port [ 752.031131] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c92304b4-2415-49fc-8605-3f067e055b96 with Priority: HIGHEST for action port [ 752.031406] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c92304b4-2415-49fc-8605-3f067e055b96 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.031406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c92304b4-2415-49fc-8605-3f067e055b96" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.031406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c92304b4-2415-49fc-8605-3f067e055b96" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.032226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c92304b4-2415-49fc-8605-3f067e055b96" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.032965] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c92304b4-2415-49fc-8605-3f067e055b96',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.257779] env[65630]: INFO networking_nsxv3.common.synchronization [None req-2596c0d3-c4fd-4ec7-bf8a-3de1fa915fe6 None None] Enqueued Resource ID: 5b9ed152-d1d3-4902-b59f-81cf39bb27f7 with Priority: HIGHEST for action port [ 752.259774] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9ed152-d1d3-4902-b59f-81cf39bb27f7 with Priority: HIGHEST for action port [ 752.259993] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b9ed152-d1d3-4902-b59f-81cf39bb27f7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.260177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b9ed152-d1d3-4902-b59f-81cf39bb27f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.260232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b9ed152-d1d3-4902-b59f-81cf39bb27f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.260470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b9ed152-d1d3-4902-b59f-81cf39bb27f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.260554] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b9ed152-d1d3-4902-b59f-81cf39bb27f7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.289751] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: UNINITIALIZED for 4s [ 752.438493] env[65630]: INFO networking_nsxv3.common.synchronization [req-fce60b80-1ec2-451f-84ce-d5b27f306a7d req-b1f77f08-aff0-4a85-aedd-f5bf70ae8c87 service nova] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_rules [ 752.438493] env[65630]: INFO networking_nsxv3.common.synchronization [req-fce60b80-1ec2-451f-84ce-d5b27f306a7d req-b1f77f08-aff0-4a85-aedd-f5bf70ae8c87 service nova] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 752.438493] env[65630]: INFO networking_nsxv3.common.synchronization [req-fce60b80-1ec2-451f-84ce-d5b27f306a7d req-b1f77f08-aff0-4a85-aedd-f5bf70ae8c87 service nova] Enqueued Resource ID: f8fe3de0-8aec-4886-9830-c7262a061073 with Priority: HIGHEST for action port [ 752.439022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_rules [ 752.439170] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 752.439270] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8fe3de0-8aec-4886-9830-c7262a061073 with Priority: HIGHEST for action port [ 752.439552] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.439676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.439745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.440026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.440128] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.441021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.441149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.441220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.441402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.441555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.441677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.441741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.441902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.441984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.442116] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.442925] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8fe3de0-8aec-4886-9830-c7262a061073 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.443074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.443134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.443278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.443367] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8fe3de0-8aec-4886-9830-c7262a061073',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.539027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c92304b4-2415-49fc-8605-3f067e055b96 [ 752.539027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.539027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.539027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.539027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.539027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.539027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c92304b4-2415-49fc-8605-3f067e055b96 already deleted. [ 752.539027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c92304b4-2415-49fc-8605-3f067e055b96" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.763537] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b9ed152-d1d3-4902-b59f-81cf39bb27f7 [ 752.764343] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.764492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.764577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.764807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.764928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.765040] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b9ed152-d1d3-4902-b59f-81cf39bb27f7 already deleted. [ 752.765143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b9ed152-d1d3-4902-b59f-81cf39bb27f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.945645] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.947543] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.947648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.947999] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8fe3de0-8aec-4886-9830-c7262a061073 with status ACTIVE [ 752.948255] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.948381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.948448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.948656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.948811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.949024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.950490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.950629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.950952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.951033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.951429] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.951762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.951762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.952161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.952161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.952335] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8fe3de0-8aec-4886-9830-c7262a061073 is going to be updated. [ 752.978347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.978753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.978861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.979122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.979261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.979420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8fe3de0-8aec-4886-9830-c7262a061073" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.452077] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.926138] env[65630]: INFO networking_nsxv3.common.synchronization [req-5ececd18-ec5d-46b4-b378-2f95b532f83d req-e3b015c1-f609-49d9-9b6f-b128fcd5a546 tempest-ListServerFiltersTestJSON-678265133 tempest-ListServerFiltersTestJSON-678265133-project-member] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 753.927307] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 753.928195] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.928454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.958142] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.958142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.958142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.958142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.958142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.958142] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be created. [ 753.982694] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.982895] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.982970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.983437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.983625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.993644] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: UNINITIALIZED for 2s [ 754.234491] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b3cb66c6-c568-4ce3-a261-4c7627b6f2e2 None None] Enqueued Resource ID: 2b2400b1-0573-4799-91df-1c4a473d08fa with Priority: HIGHEST for action port [ 754.234491] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2400b1-0573-4799-91df-1c4a473d08fa with Priority: HIGHEST for action port [ 754.234491] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b2400b1-0573-4799-91df-1c4a473d08fa taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.234491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b2400b1-0573-4799-91df-1c4a473d08fa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.234491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b2400b1-0573-4799-91df-1c4a473d08fa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.236710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b2400b1-0573-4799-91df-1c4a473d08fa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.237388] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b2400b1-0573-4799-91df-1c4a473d08fa',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.301788] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 754.302027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.302253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.302501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.302862] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.302862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.303017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.303472] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.303472] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.303472] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.303472] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.451720] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.452105] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.452290] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.452584] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.452864] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.455135] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.455374] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.455662] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.455812] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.456039] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.456154] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.456261] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.456365] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.456470] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.456569] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.456699] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.476658] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.476844] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.476931] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.477119] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.477468] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-297184ff-dec7-4e49-9b04-dc7ba15fe36b taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.477649] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.477762] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.478202] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.478290] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('297184ff-dec7-4e49-9b04-dc7ba15fe36b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.739841] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b2400b1-0573-4799-91df-1c4a473d08fa [ 754.740130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.740320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.740412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.740679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.740825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.740991] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b2400b1-0573-4799-91df-1c4a473d08fa already deleted. [ 754.741101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b2400b1-0573-4799-91df-1c4a473d08fa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.808542] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.910982] env[65630]: INFO networking_nsxv3.common.synchronization [req-41b6c824-4f8a-4360-a2ce-49762c1c1cc3 req-6ff5eaaf-8567-4c03-8e41-429cb42c5306 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_members [ 754.911318] env[65630]: INFO networking_nsxv3.common.synchronization [req-41b6c824-4f8a-4360-a2ce-49762c1c1cc3 req-6ff5eaaf-8567-4c03-8e41-429cb42c5306 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 754.912020] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_members [ 754.912380] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 754.912789] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d426a5c8-65d2-4c03-aa25-44aca1b7db44 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.913033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.913123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.914316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.914316] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.914316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.914316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.914316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.914316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.914316] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.916356] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.916356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.916356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.916356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.916356] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.916356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.916356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.916356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.916356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.916893] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.975972] env[65630]: INFO networking_nsxv3.common.synchronization [req-41b6c824-4f8a-4360-a2ce-49762c1c1cc3 req-6ff5eaaf-8567-4c03-8e41-429cb42c5306 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_rules [ 754.976243] env[65630]: INFO networking_nsxv3.common.synchronization [req-41b6c824-4f8a-4360-a2ce-49762c1c1cc3 req-6ff5eaaf-8567-4c03-8e41-429cb42c5306 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 754.976289] env[65630]: INFO networking_nsxv3.common.synchronization [req-41b6c824-4f8a-4360-a2ce-49762c1c1cc3 req-6ff5eaaf-8567-4c03-8e41-429cb42c5306 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_rules [ 754.976411] env[65630]: INFO networking_nsxv3.common.synchronization [req-41b6c824-4f8a-4360-a2ce-49762c1c1cc3 req-6ff5eaaf-8567-4c03-8e41-429cb42c5306 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_members [ 754.976525] env[65630]: INFO networking_nsxv3.common.synchronization [req-41b6c824-4f8a-4360-a2ce-49762c1c1cc3 req-6ff5eaaf-8567-4c03-8e41-429cb42c5306 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with Priority: HIGHEST for action port [ 754.980278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_rules [ 754.980278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_rules [ 754.980278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with Priority: HIGHEST for action port [ 754.980278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 754.980278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_members [ 754.980278] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.980278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.980278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.980278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.980278] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.980278] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d426a5c8-65d2-4c03-aa25-44aca1b7db44 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.980278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.980278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.980961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.980961] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.981722] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.981819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.982370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.982506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.982506] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be0978ab-a6bb-4d8a-ad28-02f96e1acd56',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.983194] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.983285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.983609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d426a5c8-65d2-4c03-aa25-44aca1b7db44 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.983609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.984422] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.984905] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.984905] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.985022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.986134] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.986296] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 297184ff-dec7-4e49-9b04-dc7ba15fe36b not found, creating... [ 754.986572] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.986754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.986871] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.987336] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.987485] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.987762] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.987976] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.988104] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.988266] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.988399] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.988534] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 297184ff-dec7-4e49-9b04-dc7ba15fe36b is going to be created. [ 755.014671] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.014671] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.014671] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.014671] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.014671] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.014671] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.310786] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397b25ae-6929-46ce-8711-37502e4943b3: rpc.has_security_group_logging(os_id): False [ 755.329743] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.329925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.329988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.330433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.330433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.330569] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.330653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.330719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.330928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.330978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.331082] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be created. [ 755.399875] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.400103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.400213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.400505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.400687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.413737] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 755.418282] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.419447] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.484738] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d426a5c8-65d2-4c03-aa25-44aca1b7db44 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.484976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.485205] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.485296] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.491442] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with status ACTIVE [ 755.491752] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.491929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.492052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.492381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.492533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.492832] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.492941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.493045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.493305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.493468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.493875] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.494065] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.494180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.494454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.494547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.494652] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 is going to be updated. [ 755.519904] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.520153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.520237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.520463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.520609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.520770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.777301] env[65630]: INFO networking_nsxv3.common.synchronization [req-5ececd18-ec5d-46b4-b378-2f95b532f83d req-75f83b2a-cdbc-4e15-ab8f-4f6dc8958ebb service nova] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_rules [ 755.777301] env[65630]: INFO networking_nsxv3.common.synchronization [req-5ececd18-ec5d-46b4-b378-2f95b532f83d req-75f83b2a-cdbc-4e15-ab8f-4f6dc8958ebb service nova] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 755.777301] env[65630]: INFO networking_nsxv3.common.synchronization [req-5ececd18-ec5d-46b4-b378-2f95b532f83d req-75f83b2a-cdbc-4e15-ab8f-4f6dc8958ebb service nova] Enqueued Resource ID: 297184ff-dec7-4e49-9b04-dc7ba15fe36b with Priority: HIGHEST for action port [ 755.777556] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_rules [ 755.777720] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 755.777831] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 297184ff-dec7-4e49-9b04-dc7ba15fe36b with Priority: HIGHEST for action port [ 755.779148] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.779256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.779988] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.780101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.780288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-297184ff-dec7-4e49-9b04-dc7ba15fe36b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.780428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.780474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.780640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.780717] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('297184ff-dec7-4e49-9b04-dc7ba15fe36b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.850710] env[65630]: INFO networking_nsxv3.common.synchronization [req-2df94b77-7bf8-456a-8998-7578b96b93eb req-221edc0c-fa68-4c19-b494-5dc619275a03 tempest-SecurityGroupRulesTestJSON-1886688061 tempest-SecurityGroupRulesTestJSON-1886688061-project-member] Enqueued Resource ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 with Priority: HIGHEST for action security_group_rules [ 755.851483] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 with Priority: HIGHEST for action security_group_rules [ 755.851732] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d33e6ecd-9d7a-45b6-af79-d24cba078722 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.851794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.851830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.854905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.854905] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d33e6ecd-9d7a-45b6-af79-d24cba078722',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.922621] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.923561] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.005361] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.008021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.008021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.008021] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.008663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.008980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.009251] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.009456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.009594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.009812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.009972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.010143] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.283503] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 297184ff-dec7-4e49-9b04-dc7ba15fe36b with status ACTIVE [ 756.283751] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.283896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.283969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.284225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.284320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.284517] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.284653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.284720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.284850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.284915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.286981] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.287145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.287226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.287419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.287528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.287592] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 297184ff-dec7-4e49-9b04-dc7ba15fe36b is going to be updated. [ 756.330697] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.330697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.330697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.330697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.330697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.330697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-297184ff-dec7-4e49-9b04-dc7ba15fe36b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.382736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.382920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.382920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.383127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.383239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.383344] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d33e6ecd-9d7a-45b6-af79-d24cba078722 already deleted. [ 756.383430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d33e6ecd-9d7a-45b6-af79-d24cba078722" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.428326] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.428326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.428326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.428326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.428326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.428326] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be updated. [ 756.428326] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.428707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.428707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.428707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.428876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.428876] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 is going to be created. [ 756.461765] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.463406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.463406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.463406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.463406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.471038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.471038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.471038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.471038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.471038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.475876] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 in Status: UNINITIALIZED for 2s [ 756.478358] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 756.513839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.513993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.514220] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.018523] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.430492] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 757.430492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.462359] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c653819-19fb-47d1-a70e-de4df7a9333a req-e1cf0cb6-ecb9-4241-9c41-f7dac1ce1cc2 tempest-ListServerFiltersTestJSON-678265133 tempest-ListServerFiltersTestJSON-678265133-project-member] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 757.462359] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 757.462359] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.462650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.522329] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.522458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.522533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.522739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.522837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.522933] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 757.553401] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.553639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.553639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.553810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.553948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.563606] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 757.675220] env[65630]: INFO networking_nsxv3.common.synchronization [None req-10a14051-dabd-43ba-8dcc-27c4054d29eb None None] Enqueued Resource ID: f1cb3f04-00fe-4550-a234-0f9d257471d2 with Priority: HIGHEST for action port [ 757.676048] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cb3f04-00fe-4550-a234-0f9d257471d2 with Priority: HIGHEST for action port [ 757.676421] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1cb3f04-00fe-4550-a234-0f9d257471d2 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.676579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1cb3f04-00fe-4550-a234-0f9d257471d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.676635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1cb3f04-00fe-4550-a234-0f9d257471d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.676938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1cb3f04-00fe-4550-a234-0f9d257471d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.677061] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1cb3f04-00fe-4550-a234-0f9d257471d2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.179261] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1cb3f04-00fe-4550-a234-0f9d257471d2 [ 758.179493] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.179619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.179707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.180013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.180118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.180283] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1cb3f04-00fe-4550-a234-0f9d257471d2 already deleted. [ 758.180374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1cb3f04-00fe-4550-a234-0f9d257471d2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.491247] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 758.491538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.496498] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 in Status: SUCCESS [ 758.496498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.496498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.496833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.496867] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.497015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.497315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.497315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.497424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.497531] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.499198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.499438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.499665] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.500476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.500476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.500476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.500476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.500476] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.690105] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.690316] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.690418] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.691064] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.691261] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.691363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.691498] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.691756] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.693310] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.693310] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.693310] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.693310] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.693310] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.693310] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.693310] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.693310] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.718859] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.719028] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.719433] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.719433] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-87" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.719739] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-6bab8b34-df10-43a9-b37f-d1232237fac1 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.720954] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.720954] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.720954] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.720954] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bab8b34-df10-43a9-b37f-d1232237fac1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.975943] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5809b2e0-d069-4c9d-90c7-fd040a5996da None None] Enqueued Resource ID: 9c1d8ae1-a759-4a02-bb9c-bb85206df15d with Priority: HIGHEST for action port [ 758.977605] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1d8ae1-a759-4a02-bb9c-bb85206df15d with Priority: HIGHEST for action port [ 758.977605] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c1d8ae1-a759-4a02-bb9c-bb85206df15d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.977605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c1d8ae1-a759-4a02-bb9c-bb85206df15d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.977605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c1d8ae1-a759-4a02-bb9c-bb85206df15d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.977605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c1d8ae1-a759-4a02-bb9c-bb85206df15d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.977950] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c1d8ae1-a759-4a02-bb9c-bb85206df15d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.000744] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.008427] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.226133] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.226133] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.226133] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.226133] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.226133] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.226133] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 6bab8b34-df10-43a9-b37f-d1232237fac1 not found, creating... [ 759.226133] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.226133] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.227334] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.227334] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.227334] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.227334] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.227334] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.227548] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.227817] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.227903] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.228118] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 6bab8b34-df10-43a9-b37f-d1232237fac1 is going to be created. [ 759.253326] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.253326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.253326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.253326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.253326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.253326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.482224] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c1d8ae1-a759-4a02-bb9c-bb85206df15d [ 759.482959] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.482959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.482959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.482959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.483230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.483230] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c1d8ae1-a759-4a02-bb9c-bb85206df15d already deleted. [ 759.483230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c1d8ae1-a759-4a02-bb9c-bb85206df15d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.505484] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.513193] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.579181] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 759.579484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.579582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.579789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.579983] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.580133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.580224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.580342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.580446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.580523] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.006700] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c653819-19fb-47d1-a70e-de4df7a9333a req-c6369002-841a-4e57-bbc0-9127b040f41f service nova] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_rules [ 760.006975] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c653819-19fb-47d1-a70e-de4df7a9333a req-c6369002-841a-4e57-bbc0-9127b040f41f service nova] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 760.010059] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c653819-19fb-47d1-a70e-de4df7a9333a req-c6369002-841a-4e57-bbc0-9127b040f41f service nova] Enqueued Resource ID: 6bab8b34-df10-43a9-b37f-d1232237fac1 with Priority: HIGHEST for action port [ 760.010059] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_rules [ 760.010059] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 760.010059] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bab8b34-df10-43a9-b37f-d1232237fac1 with Priority: HIGHEST for action port [ 760.010059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.011421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.011421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.014110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.014344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.014502] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be updated. [ 760.022232] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.022396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.023659] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.023659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.023659] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bab8b34-df10-43a9-b37f-d1232237fac1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.023659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.023659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.023659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.023878] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bab8b34-df10-43a9-b37f-d1232237fac1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.025230] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.025398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.025538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.025798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.025905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.026089] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 is going to be updated. [ 760.031062] env[65630]: INFO networking_nsxv3.common.synchronization [None req-fd03a272-3bb2-4946-8f2a-2d45a91ff76a None None] Enqueued Resource ID: d00e6144-0bbe-4f8c-9c35-684d9b62d576 with Priority: HIGHEST for action port [ 760.033430] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d00e6144-0bbe-4f8c-9c35-684d9b62d576 with Priority: HIGHEST for action port [ 760.033827] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d00e6144-0bbe-4f8c-9c35-684d9b62d576 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.034036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d00e6144-0bbe-4f8c-9c35-684d9b62d576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.034163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d00e6144-0bbe-4f8c-9c35-684d9b62d576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.034525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d00e6144-0bbe-4f8c-9c35-684d9b62d576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.034693] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00e6144-0bbe-4f8c-9c35-684d9b62d576',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.088636] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.097590] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.097590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.097590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.097840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.097923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.102036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.102036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.102036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.102036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.102036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.119714] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 in Status: IN_PROGRESS for 2s [ 760.120205] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 760.532533] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bab8b34-df10-43a9-b37f-d1232237fac1 with status ACTIVE [ 760.534676] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.534676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.534676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.534676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.534676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.535112] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.535277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.535372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.535865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.535995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.536304] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.536465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.538092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.538902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.538902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.538902] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bab8b34-df10-43a9-b37f-d1232237fac1 is going to be updated. [ 760.540121] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d00e6144-0bbe-4f8c-9c35-684d9b62d576 [ 760.540345] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.540465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.540532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.540740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.540848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.540984] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d00e6144-0bbe-4f8c-9c35-684d9b62d576 already deleted. [ 760.542138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d00e6144-0bbe-4f8c-9c35-684d9b62d576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.569427] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.569427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.569427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.569789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.569789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.570969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bab8b34-df10-43a9-b37f-d1232237fac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.591780] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.676976] env[65630]: INFO networking_nsxv3.common.synchronization [req-839bb216-9b8c-4b77-ad51-0abcfd4bd017 req-502baa1e-2378-4faf-87d5-ea9835c06550 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_members [ 760.678377] env[65630]: INFO networking_nsxv3.common.synchronization [req-839bb216-9b8c-4b77-ad51-0abcfd4bd017 req-502baa1e-2378-4faf-87d5-ea9835c06550 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 760.679184] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 with Priority: HIGHEST for action security_group_members [ 760.679405] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 760.680113] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d426a5c8-65d2-4c03-aa25-44aca1b7db44 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.680379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.680710] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.680854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.743917] env[65630]: INFO networking_nsxv3.common.synchronization [req-839bb216-9b8c-4b77-ad51-0abcfd4bd017 req-502baa1e-2378-4faf-87d5-ea9835c06550 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_rules [ 760.744451] env[65630]: INFO networking_nsxv3.common.synchronization [req-839bb216-9b8c-4b77-ad51-0abcfd4bd017 req-502baa1e-2378-4faf-87d5-ea9835c06550 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 760.744451] env[65630]: INFO networking_nsxv3.common.synchronization [req-839bb216-9b8c-4b77-ad51-0abcfd4bd017 req-502baa1e-2378-4faf-87d5-ea9835c06550 tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with Priority: HIGHEST for action port [ 760.744966] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_rules [ 760.745136] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 760.745219] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with Priority: HIGHEST for action port [ 760.745522] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.745635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.745876] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.745977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.746093] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.746197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.746259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.746468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.746549] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be0978ab-a6bb-4d8a-ad28-02f96e1acd56',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.806427] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e9da431d-680a-4483-9d32-b79b86fe5759 None None] Enqueued Resource ID: 8008064c-ae31-4825-80a9-24ff7781dafe with Priority: HIGHEST for action port [ 760.807471] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8008064c-ae31-4825-80a9-24ff7781dafe with Priority: HIGHEST for action port [ 760.809444] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-8008064c-ae31-4825-80a9-24ff7781dafe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.809444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8008064c-ae31-4825-80a9-24ff7781dafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.809444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8008064c-ae31-4825-80a9-24ff7781dafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.809444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8008064c-ae31-4825-80a9-24ff7781dafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.809444] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8008064c-ae31-4825-80a9-24ff7781dafe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.027445] env[65630]: INFO networking_nsxv3.common.synchronization [req-6699a05d-e5ee-4180-985b-cb00b7c6c89d req-73c1f957-6e72-412a-a0a9-45cecdc65b29 tempest-VolumesAssistedSnapshotsTest-482920267 tempest-VolumesAssistedSnapshotsTest-482920267-project-member] Enqueued Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_members [ 761.029613] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGHEST for action security_group_members [ 761.030092] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.030250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.030353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.030624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.030864] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.031021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.031090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.031317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.031412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.031539] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.099382] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.099382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.099382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.099382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.099575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.099575] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 761.153252] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.153252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.153252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.153252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.153252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.173587] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 761.250817] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be0978ab-a6bb-4d8a-ad28-02f96e1acd56 with status ACTIVE [ 761.251755] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.253052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.253169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.253971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.253971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.253971] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.253971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.253971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.254257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.254257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.254476] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.254553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.254585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.254968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.254968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.254968] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be0978ab-a6bb-4d8a-ad28-02f96e1acd56 is going to be updated. [ 761.287347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.287549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.288095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.288095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.288095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.288446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be0978ab-a6bb-4d8a-ad28-02f96e1acd56" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.312440] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8008064c-ae31-4825-80a9-24ff7781dafe [ 761.312745] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.312852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.312917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.313165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.313270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.313402] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8008064c-ae31-4825-80a9-24ff7781dafe already deleted. [ 761.313476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8008064c-ae31-4825-80a9-24ff7781dafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.537820] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.538189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.538672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.538672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.538814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.539012] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.539119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.540300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.540300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.540300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.540469] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 is going to be updated. [ 761.580696] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.581009] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.581146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.583422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.583422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.594574] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 in Status: IN_PROGRESS for 2s [ 761.596754] env[65630]: INFO networking_nsxv3.common.synchronization [req-680b6570-dc5a-44a6-9b01-a6c23a7c9681 req-53b854f9-825e-47b8-9246-794abdaca9f5 tempest-FloatingIPsAssociationTestJSON-476441825 tempest-FloatingIPsAssociationTestJSON-476441825-project-member] Enqueued Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 761.597776] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 with Priority: HIGHEST for action security_group_members [ 761.598368] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f9d43bc-6007-4e6a-81c6-321db263b170 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.598478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.598478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.602401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.602401] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.602401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.602401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.602401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.602401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.602401] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f9d43bc-6007-4e6a-81c6-321db263b170',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.106852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.107087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.107171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.107482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.107610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.107984] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.107984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.108104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.108317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.108424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.108559] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 is going to be updated. [ 762.135787] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 in Status: SUCCESS [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.135787] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.135787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.135787] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.137267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.137503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.137965] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.137965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.137965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.138200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.138291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.138390] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.141653] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 762.141857] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.142450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.142555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.142756] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.143171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.143308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.143506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.143597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.143699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.143791] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.145108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.147083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.147083] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.147083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.147083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.147083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.147083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.147083] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.154013] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.154214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.154214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.155213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.155213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.167754] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: IN_PROGRESS for 2s [ 762.407374] env[65630]: INFO networking_nsxv3.common.synchronization [req-c11dc3ae-fedb-4b30-8fec-abf1f86b2a16 req-821e6efb-a940-46e5-b6af-e56d6a55e2d7 tempest-ServersTestFqdnHostnames-1506153026 tempest-ServersTestFqdnHostnames-1506153026-project-member] Enqueued Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_members [ 762.408091] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 with Priority: HIGHEST for action security_group_members [ 762.408416] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8db9dba-41a6-4390-8a03-e9d1a073b831 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.410103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.410103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.410103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.410103] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.410103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.410103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.410103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.410404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.410404] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8db9dba-41a6-4390-8a03-e9d1a073b831',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.637915] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d426a5c8-65d2-4c03-aa25-44aca1b7db44',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.642283] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.642283] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.642283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.642283] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 is going to be deleted. [ 762.646669] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.646669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.648220] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.685693] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.685904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.685987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.686310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.686439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.686619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.913192] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.913617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.913813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.914297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.914391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.914636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.914810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.915066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.915148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.915323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.915621] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 is going to be updated. [ 762.965824] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.965824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.965824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.965824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.965824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.980946] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 in Status: IN_PROGRESS for 2s [ 763.143898] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d426a5c8-65d2-4c03-aa25-44aca1b7db44: rpc.has_security_group_logging(os_id): False [ 763.150864] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.167112] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.167268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.168789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.169096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.169357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.169662] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.169748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.169748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.170023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.170138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.170238] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 is going to be created. [ 763.186996] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 763.186996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.186996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.186996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.186996] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.187619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.187844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.188142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.188543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.188756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.189085] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.189334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.189487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.189725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.190071] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.190352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.190829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.191167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.192727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.192727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.192727] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.192727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.192727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.193086] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.193334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.193479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.193703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.193859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.194027] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.196364] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d426a5c8-65d2-4c03-aa25-44aca1b7db44], does not exist path=[/infra/domains/default/groups/d426a5c8-65d2-4c03-aa25-44aca1b7db44]."\n}' [ 763.196600] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d426a5c8-65d2-4c03-aa25-44aca1b7db44 [ 763.197037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 763.232122] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.232122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.232320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.233061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.234135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.234397] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.234512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.234571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.238160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.238160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.238160] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.238160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.238160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.238160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.238160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.238160] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d426a5c8-65d2-4c03-aa25-44aca1b7db44 is going to be created. [ 763.254074] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d426a5c8-65d2-4c03-aa25-44aca1b7db44], does not exist path=[/infra/domains/default/groups/d426a5c8-65d2-4c03-aa25-44aca1b7db44]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d426a5c8-65d2-4c03-aa25-44aca1b7db44 [ 763.254177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d426a5c8-65d2-4c03-aa25-44aca1b7db44" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.254759] env[65630]: Traceback (most recent call last): [ 763.254812] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 763.254812] env[65630]: return func(*args, **kwargs) [ 763.254912] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 763.254912] env[65630]: res.raise_for_status() [ 763.254912] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 763.254912] env[65630]: raise HTTPError(http_error_msg, response=self) [ 763.254912] env[65630]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d426a5c8-65d2-4c03-aa25-44aca1b7db44 [ 763.254912] env[65630]: During handling of the above exception, another exception occurred: [ 763.254912] env[65630]: Traceback (most recent call last): [ 763.254912] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 763.254912] env[65630]: listener.cb(fileno) [ 763.254912] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 763.254912] env[65630]: result = function(*args, **kwargs) [ 763.254912] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 763.254912] env[65630]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 763.254912] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 763.254912] env[65630]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 763.254912] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 763.254912] env[65630]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 763.254912] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 763.254912] env[65630]: res.raise_for_status() [ 763.254912] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 763.254912] env[65630]: raise HTTPError(http_error_msg, response=self) [ 763.254912] env[65630]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d426a5c8-65d2-4c03-aa25-44aca1b7db44 [ 763.254912] env[65630]: Removing descriptor: 21 [ 763.606211] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 in Status: SUCCESS [ 763.606211] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 deletion is rescheduled due to dependency. [ 763.606211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.656143] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.656611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.656746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.657034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.657140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.657815] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be updated. [ 763.679294] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b4d0e569-4f15-4923-83d4-ae9217acce9e tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 763.679671] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 763.679988] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.680200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.680267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.680532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.680616] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.693071] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.693071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.693071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.693071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.693320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.697031] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55cab18d-dd48-49fe-b38f-0e7e827f237c: rpc.has_security_group_logging(os_id): False [ 763.700944] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.710580] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 763.721443] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.721613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.721665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.721894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.721987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.724390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.724390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.724390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.724941] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.724941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.724941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.724941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.724941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.725133] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be created. [ 763.792065] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.792212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.792359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.792492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.792754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.805927] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 764.175776] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1827308e-a18d-4057-8271-2c8649925bfe tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 764.176345] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 764.176666] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.176764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.181419] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 in Status: SUCCESS [ 764.181419] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f9d43bc-6007-4e6a-81c6-321db263b170 deletion is rescheduled due to dependency. [ 764.181567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f9d43bc-6007-4e6a-81c6-321db263b170" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.204100] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.209615] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.209615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.209615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.209615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.209854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.209854] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 already deleted. [ 764.209854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.210353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.210531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.210617] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.708148] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.708520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.708563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.708786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.709160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.709160] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 764.732754] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.732906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.732977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.733234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.733345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.733433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 already deleted. [ 764.733517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.745942] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.746180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.746255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.746537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.746712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.764032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 765.003757] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 in Status: SUCCESS [ 765.004070] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8db9dba-41a6-4390-8a03-e9d1a073b831 deletion is rescheduled due to dependency. [ 765.004251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8db9dba-41a6-4390-8a03-e9d1a073b831" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.725343] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 765.725343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.725343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.725343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.725343] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.725343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.725343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.725343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.725343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.725343] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.820945] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 765.821438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.821662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.821903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.822025] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.228627] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.325260] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.325260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.730866] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.772789] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 766.773092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.773393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.773575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.773785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.773979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.773979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.774204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.774310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.774424] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.236368] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.236368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.236368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.236368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.236368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.236368] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be updated. [ 767.264949] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.264949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.265291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.265339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.265829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.276226] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 767.278606] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.780815] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.907304] env[65630]: INFO networking_nsxv3.common.synchronization [None req-20854816-50c4-4be1-ba54-05a04ee9dc0f None None] Enqueued Resource ID: a4fd295c-3ea5-41be-bc87-cd1efe444bba with Priority: HIGHEST for action port [ 767.907489] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4fd295c-3ea5-41be-bc87-cd1efe444bba with Priority: HIGHEST for action port [ 767.908112] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4fd295c-3ea5-41be-bc87-cd1efe444bba taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.908242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4fd295c-3ea5-41be-bc87-cd1efe444bba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.908310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4fd295c-3ea5-41be-bc87-cd1efe444bba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.908573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4fd295c-3ea5-41be-bc87-cd1efe444bba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.908653] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4fd295c-3ea5-41be-bc87-cd1efe444bba',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.283641] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.284161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.284161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.284161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.284277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.284326] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 768.319607] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.319785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.319847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.320390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.320501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.338897] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 768.411190] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4fd295c-3ea5-41be-bc87-cd1efe444bba [ 768.411435] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.411554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.411613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.411856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.411950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.412121] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4fd295c-3ea5-41be-bc87-cd1efe444bba already deleted. [ 768.412232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4fd295c-3ea5-41be-bc87-cd1efe444bba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.288918] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 4s [ 770.353735] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 770.354121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.354522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.354522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.354658] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.354784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.354847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.355010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.355094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.355177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.355273] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.809079] env[65630]: INFO networking_nsxv3.common.synchronization [None req-53d7ee4e-cb12-469d-a983-94843366c5c6 None None] Enqueued Resource ID: 87c9099a-531f-40d2-a63c-00e3584e8edc with Priority: HIGHEST for action port [ 770.811185] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87c9099a-531f-40d2-a63c-00e3584e8edc with Priority: HIGHEST for action port [ 770.811185] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-87c9099a-531f-40d2-a63c-00e3584e8edc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.811185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87c9099a-531f-40d2-a63c-00e3584e8edc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.811185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87c9099a-531f-40d2-a63c-00e3584e8edc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.811185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87c9099a-531f-40d2-a63c-00e3584e8edc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.811185] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87c9099a-531f-40d2-a63c-00e3584e8edc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.859812] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.860032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.860101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.860355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.860540] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.860701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.860753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.860888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.860978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.861185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.861350] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.861446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.861514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.861667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.861810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.861902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.861962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.862154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.862236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.862374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.862404] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.302518] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 771.302732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.302899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.303132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.303323] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.303434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.303495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.303649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.303726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.303805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.303964] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.304125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.304332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.304385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.304504] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.304691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.304691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.304778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.304856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.304952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.306247] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.315765] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87c9099a-531f-40d2-a63c-00e3584e8edc [ 771.317139] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.317139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.317139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.317139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.317139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.317139] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87c9099a-531f-40d2-a63c-00e3584e8edc already deleted. [ 771.317139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87c9099a-531f-40d2-a63c-00e3584e8edc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.358075] env[65630]: INFO networking_nsxv3.common.synchronization [req-86b08a10-ea5a-4409-80ba-f855b59224aa req-b9e0737c-94c5-476d-828f-01754705f84c tempest-AttachInterfacesV270Test-858361944 tempest-AttachInterfacesV270Test-858361944-project-member] Enqueued Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_members [ 771.359264] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_members [ 771.360448] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.360448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.360448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.360448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.360713] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.360713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.360713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.360828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.360905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.361085] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.365630] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55cab18d-dd48-49fe-b38f-0e7e827f237c: rpc.has_security_group_logging(os_id): False [ 771.389038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.389038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.389038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.389038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.389038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.389038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.389038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.390974] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.390974] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.390974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.390974] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 771.467025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.467025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.467025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.467025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.467025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.481676] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 771.790592] env[65630]: INFO networking_nsxv3.common.synchronization [req-ec36cbf9-2c92-4c1d-9ea7-f673cbc30dfe req-744f1abc-7e96-4a66-830b-d131ab6b39ed tempest-ServerAddressesNegativeTestJSON-658209887 tempest-ServerAddressesNegativeTestJSON-658209887-project-member] Enqueued Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_members [ 771.790592] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGHEST for action security_group_members [ 771.790785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.790947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.792922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.792922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.792922] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.792922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.792922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.792922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.792922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.793358] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.811801] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b37c50-233f-4cfb-bd1b-645d04b17ca5: rpc.has_security_group_logging(os_id): False [ 771.815321] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.815321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-27" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.815321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-27" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.815321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-27" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.815321] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.815321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.815321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.815321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.815321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.815321] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.815321] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.815884] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.815884] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.815884] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.815884] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.816051] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.841827] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.842041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.842161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.842401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.848364] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.848650] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.848758] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.848933] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-27" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.849326] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.849506] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.849622] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.849947] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.850127] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bc68951-cd1f-4cfc-ae5f-56952ef4c585',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.864899] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.865035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.866898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.867154] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.867272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.867414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.867602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.867732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.868497] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.868497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.868497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.868497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.868497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.868703] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.868703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.868703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.868854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.868935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.869485] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be updated. [ 771.872465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.872577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.872669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.872868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.872974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.873052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.873253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.873307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.873349] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 already deleted. [ 771.873458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.957081] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.957291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.957363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.957586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.957732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.973885] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 772.298778] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.298963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.299079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.299283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.322147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.322147] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.322147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.322147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.322147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.322147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.322147] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd is going to be updated. [ 772.355578] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.355848] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.356323] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.356430] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.356535] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.356714] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 4bc68951-cd1f-4cfc-ae5f-56952ef4c585 not found, creating... [ 772.357056] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.357319] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.357460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.357728] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.357874] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.358231] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.358566] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.358566] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.358827] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.358972] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.359135] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 4bc68951-cd1f-4cfc-ae5f-56952ef4c585 is going to be created. [ 772.363939] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.364123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.364183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.364419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.364586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.375802] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd in Status: IN_PROGRESS for 2s [ 772.384914] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.385142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.385263] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.385925] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.386204] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.386452] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.076260] env[65630]: INFO networking_nsxv3.common.synchronization [req-86b08a10-ea5a-4409-80ba-f855b59224aa req-0951e5e7-810d-4ad4-99c0-eb6579ba2306 service nova] Enqueued Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_rules [ 773.076260] env[65630]: INFO networking_nsxv3.common.synchronization [req-86b08a10-ea5a-4409-80ba-f855b59224aa req-0951e5e7-810d-4ad4-99c0-eb6579ba2306 service nova] Enqueued Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_members [ 773.076260] env[65630]: INFO networking_nsxv3.common.synchronization [req-86b08a10-ea5a-4409-80ba-f855b59224aa req-0951e5e7-810d-4ad4-99c0-eb6579ba2306 service nova] Enqueued Resource ID: 4bc68951-cd1f-4cfc-ae5f-56952ef4c585 with Priority: HIGHEST for action port [ 773.076961] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_rules [ 773.077293] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_members [ 773.077535] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc68951-cd1f-4cfc-ae5f-56952ef4c585 with Priority: HIGHEST for action port [ 773.077998] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.078335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.078725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.084202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.084202] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.084202] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.084202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.087452] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.087452] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.087452] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.087452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.087452] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bc68951-cd1f-4cfc-ae5f-56952ef4c585',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.422741] env[65630]: INFO networking_nsxv3.common.synchronization [req-2d4369e1-0073-4797-9f60-1e9f71429c47 req-8b26e481-5224-4ac9-8029-4ce77ea0e0e6 tempest-ServersAdminNegativeTestJSON-2028070641 tempest-ServersAdminNegativeTestJSON-2028070641-project-member] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 773.423090] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 773.423469] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.423663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.423741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.424042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.424287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.424443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.424543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.424785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.424950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.425119] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.513247] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 773.513565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.513782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.514069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.514170] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.590988] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.591233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.591419] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.595825] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bc68951-cd1f-4cfc-ae5f-56952ef4c585 with status ACTIVE [ 773.595825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.595825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.595825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.595825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.595825] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bc68951-cd1f-4cfc-ae5f-56952ef4c585 is going to be updated. [ 773.618921] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.619113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.619188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.619467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.619610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.619807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bc68951-cd1f-4cfc-ae5f-56952ef4c585" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.676804] env[65630]: INFO networking_nsxv3.common.synchronization [req-27a9f0b0-659e-4043-8c6d-0f61b0fd32e1 req-6137134c-f7d9-4520-951d-deb5044ac51b tempest-ServerMetadataTestJSON-1411665217 tempest-ServerMetadataTestJSON-1411665217-project-member] Enqueued Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_members [ 773.678031] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 with Priority: HIGHEST for action security_group_members [ 773.678031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.678980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.679076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.679458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.679662] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.679778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.679844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.680030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.680199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.680388] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcabb3c1-63c7-4e6e-99e0-7cb17896f367',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.927890] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.988102] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 773.988373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.988563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.988787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.988890] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.023239] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.023239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.023239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.023644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.023644] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.023644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.023759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.023840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.023930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.024031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.024119] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.098338] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.183621] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.183621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.183621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.183621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.210180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.210425] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.210567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.210627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.210804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.210881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.210965] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 is going to be updated. [ 774.241990] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.242184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.242267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.242450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.242584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.256541] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 in Status: IN_PROGRESS for 2s [ 774.390541] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd in Status: SUCCESS [ 774.390736] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd deletion is rescheduled due to dependency. [ 774.390819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.430107] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.475158] env[65630]: INFO networking_nsxv3.common.synchronization [req-aa26019a-0a3f-4193-bf11-43a9a896c9a1 req-256a9e36-574a-403f-bf9b-87b322586a84 tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 774.475878] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 774.476210] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.476362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.476415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.476661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.476779] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.476872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.476920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.477084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.477139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.477228] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.492563] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.492730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.492788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.493016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.493184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.493282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.493357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.493491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.493601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.493759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.493759] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.527394] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.531096] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.531096] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.531096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.532206] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.532439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.532594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.532843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.533203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.533387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.533583] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.602085] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.602085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.602085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.602085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.602085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.602085] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 is going to be created. [ 774.627422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.627422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.627422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.627422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.627422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.638242] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 in Status: UNINITIALIZED for 2s [ 774.933583] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.933583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.933583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.933583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.933583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.933583] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be updated. [ 774.952474] env[65630]: INFO networking_nsxv3.common.synchronization [req-237703e4-8367-40a3-8f09-bb47ffb6c6b3 req-bda6d8d3-b696-42f9-b83a-96d8124c833f tempest-MigrationsAdminTest-1222576144 tempest-MigrationsAdminTest-1222576144-project-member] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 774.952687] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 774.953042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.953197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.953278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.953571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.953748] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.953876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.953947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.954149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.954269] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.954371] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.967469] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.967709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.967709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.967910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.968051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.978844] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: IN_PROGRESS for 2s [ 774.979489] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.979622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.979844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.979937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.996681] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.998134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.998134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.999215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.999215] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.999215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.999215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.999215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.999215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.999215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.999526] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.999526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.999603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.000167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.000167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.000167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.000167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.000167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.000460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.000460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.000460] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.024804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.025252] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.025389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.025459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.025662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.025747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.025840] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be updated. [ 775.036282] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55cab18d-dd48-49fe-b38f-0e7e827f237c: rpc.has_security_group_logging(os_id): False [ 775.062939] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.063103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.063176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.063638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.063638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.063751] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.063811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.063845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.063984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.064074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.064335] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.064413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.064474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.064619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.064694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.064877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.064985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.065042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.065187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.065260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.065347] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 775.076808] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.076808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.076808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.076808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.076808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.102062] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 775.152771] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.155038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.155038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.155038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.155038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.173082] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 775.458039] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.458039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.458039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.458447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.458447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.458675] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.458774] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.458861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.459045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.459148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.459204] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 already deleted. [ 775.459269] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.502307] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b37c50-233f-4cfb-bd1b-645d04b17ca5: rpc.has_security_group_logging(os_id): False [ 775.522360] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.522360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.522360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.522567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.522666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.522865] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.522967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.523042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.523206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.523285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.523470] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.523564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.523626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.523768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.523842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.524259] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.524259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.524259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.524458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.524458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.524523] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be updated. [ 775.600861] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.601024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.601125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.601356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.601490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.619360] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 775.929880] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.931032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.931227] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.931502] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.933471] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.933816] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.933955] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.934208] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.934354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.934760] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.934888] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.934994] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.935114] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.935224] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.935327] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.935457] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.954825] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.954985] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.955259] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.956134] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.956134] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.956134] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.956134] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.957255] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.957402] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1796564-16f3-4a2b-8b12-f5f6dbf341f7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.267140] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 in Status: IN_PROGRESS for 4s [ 776.461647] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.461647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.461647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.461647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.461647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.461647] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port c1796564-16f3-4a2b-8b12-f5f6dbf341f7 not found, creating... [ 776.461647] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.461647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.461647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.461647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.462633] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.462745] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.462931] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.463036] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.463396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.464246] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.464487] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: c1796564-16f3-4a2b-8b12-f5f6dbf341f7 is going to be created. [ 776.486494] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.486721] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.486975] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.487279] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.487498] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.487724] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.650318] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 in Status: SUCCESS [ 776.650646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.650806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.650979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.651727] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.651727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.651879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.652331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.652331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.652331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.652471] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.989331] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: SUCCESS [ 776.989609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.112723] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 777.113518] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e deletion is rescheduled due to dependency. [ 777.113703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.155953] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.156138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.156195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.156418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.156580] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.156698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.156771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.157348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.157348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.157348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.157348] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.157348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.157348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.157592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.157592] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.157706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.157770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.158132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.158217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.158298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.158387] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.189672] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 777.193112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.247410] env[65630]: INFO networking_nsxv3.common.synchronization [req-237703e4-8367-40a3-8f09-bb47ffb6c6b3 req-2fe9f7c7-a021-48b6-85ee-872b27a5e76f service nova] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_rules [ 777.247653] env[65630]: INFO networking_nsxv3.common.synchronization [req-237703e4-8367-40a3-8f09-bb47ffb6c6b3 req-2fe9f7c7-a021-48b6-85ee-872b27a5e76f service nova] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 777.247703] env[65630]: INFO networking_nsxv3.common.synchronization [req-237703e4-8367-40a3-8f09-bb47ffb6c6b3 req-2fe9f7c7-a021-48b6-85ee-872b27a5e76f service nova] Enqueued Resource ID: c1796564-16f3-4a2b-8b12-f5f6dbf341f7 with Priority: HIGHEST for action port [ 777.248217] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_rules [ 777.249318] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 777.249318] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1796564-16f3-4a2b-8b12-f5f6dbf341f7 with Priority: HIGHEST for action port [ 777.249318] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.249318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.249318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.249769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.249769] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.250786] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.250934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.251035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.251274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.251462] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.251886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.251886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.251886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.251886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.252172] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.252994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.253156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.253248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.253448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.253776] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1796564-16f3-4a2b-8b12-f5f6dbf341f7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.634525] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 777.634835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.664129] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5d959e5-8b2a-40d2-918d-da1d80daa362: rpc.has_security_group_logging(os_id): False [ 777.681542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.681700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.681700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.683151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.683151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.683151] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.683151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.683151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.683151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.683545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.683545] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.683662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.683793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.684053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.684715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.684715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.684715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.684933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.685012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.685094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.685232] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 is going to be created. [ 777.750490] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.751159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.751159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.751159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.751277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.760451] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.760741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.760846] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.761872] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1796564-16f3-4a2b-8b12-f5f6dbf341f7 with status ACTIVE [ 777.762115] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.762286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.762449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.762635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.762635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.762865] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.762932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.763032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.763124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.763209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.763393] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.763490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.763552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.763696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.763772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.763857] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1796564-16f3-4a2b-8b12-f5f6dbf341f7 is going to be updated. [ 777.768874] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 in Status: IN_PROGRESS for 2s [ 777.789480] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.789632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.789712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.789912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.790059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.790225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1796564-16f3-4a2b-8b12-f5f6dbf341f7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.252752] env[65630]: INFO networking_nsxv3.common.synchronization [req-2ce4da5c-027e-4cfc-ab09-a285e8f97ede req-aaf4b683-5b6b-416f-8b4a-2772ba262252 tempest-ServerActionsV293TestJSON-1369746759 tempest-ServerActionsV293TestJSON-1369746759-project-member] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_members [ 778.253426] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_members [ 778.253742] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.253847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.253915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.254192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.254510] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.254510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.254629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.254748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.254832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.254928] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.269181] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.278389] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 in Status: SUCCESS [ 778.278571] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcabb3c1-63c7-4e6e-99e0-7cb17896f367 deletion is rescheduled due to dependency. [ 778.278690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcabb3c1-63c7-4e6e-99e0-7cb17896f367" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.671620] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-570 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.672102] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-570" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.672102] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-570" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.672303] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-570" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.672863] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.672863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.672863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.673122] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.673215] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.673422] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.673552] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.673633] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.673732] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.673841] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.673937] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.674112] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.694800] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.694800] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.694800] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.695024] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-570" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.695950] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-43b45920-3465-404c-8e27-9168a9275ffc taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.696896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.696896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.696896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.696896] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b45920-3465-404c-8e27-9168a9275ffc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.757604] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.757749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.757824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.758053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.758150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.758346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.758463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.758522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.758653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.758729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.758814] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c already deleted. [ 778.758893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.771564] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.771815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.771815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.772175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.772243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.772314] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 is going to be created. [ 778.799394] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.799671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.799671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.799896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.800073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.810050] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: UNINITIALIZED for 2s [ 779.201038] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.201038] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.201038] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.201038] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.201363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.202027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 43b45920-3465-404c-8e27-9168a9275ffc not found, creating... [ 779.202027] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.202027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.202027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.202503] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.202587] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.202846] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.202993] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.203293] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.203734] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.203919] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.204103] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 43b45920-3465-404c-8e27-9168a9275ffc is going to be created. [ 779.224831] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.225088] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.225191] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.225458] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.225673] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.225891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.781390] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 in Status: SUCCESS [ 779.781765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.011860] env[65630]: INFO networking_nsxv3.common.synchronization [req-2ce4da5c-027e-4cfc-ab09-a285e8f97ede req-7d1d773d-f5c5-4c1f-80fd-5520a30df45e service nova] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_rules [ 780.012067] env[65630]: INFO networking_nsxv3.common.synchronization [req-2ce4da5c-027e-4cfc-ab09-a285e8f97ede req-7d1d773d-f5c5-4c1f-80fd-5520a30df45e service nova] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_members [ 780.012226] env[65630]: INFO networking_nsxv3.common.synchronization [req-2ce4da5c-027e-4cfc-ab09-a285e8f97ede req-7d1d773d-f5c5-4c1f-80fd-5520a30df45e service nova] Enqueued Resource ID: 43b45920-3465-404c-8e27-9168a9275ffc with Priority: HIGHEST for action port [ 780.012955] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_rules [ 780.014245] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_members [ 780.014320] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43b45920-3465-404c-8e27-9168a9275ffc with Priority: HIGHEST for action port [ 780.014671] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.014750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.014915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.015072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.015160] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.016141] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.016213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.016295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.016480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.016678] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.016730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.016788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.016930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.017099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.017206] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.019239] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-43b45920-3465-404c-8e27-9168a9275ffc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.019239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.019239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.019239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.019239] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b45920-3465-404c-8e27-9168a9275ffc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.520539] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.520539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.520539] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.521562] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43b45920-3465-404c-8e27-9168a9275ffc with status ACTIVE [ 780.522153] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.522153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.522153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.522343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.522343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.522492] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.522870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.522870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.522870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.522870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.524292] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.524445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.524512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.524804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.525197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.525197] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43b45920-3465-404c-8e27-9168a9275ffc is going to be updated. [ 780.548049] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.548049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.548295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.548334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.548461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.548651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43b45920-3465-404c-8e27-9168a9275ffc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.821114] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: SUCCESS [ 780.821384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.821588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.821897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.822214] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.822382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.822458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.824060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.824192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.825300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.825300] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.027028] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.327987] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.328198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.328281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.328692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.328692] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.328790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.328790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.328951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.329056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.329150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.329307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.329439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.330082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.330082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.330082] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.330082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.330082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.330082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.330316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.330316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.330316] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.532415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.532415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.532415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.532415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.532415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.532415] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c is going to be created. [ 781.566018] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.566175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.566235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.566441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.566596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.578670] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: UNINITIALIZED for 2s [ 781.834451] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c09c32-a206-4c5b-9a2a-99cacfd18ac7: rpc.has_security_group_logging(os_id): False [ 781.858134] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.858290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.858373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.858613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.859131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.859131] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.859131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.859131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.859300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.859461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.859548] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.859720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.859764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.859891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.859967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.861164] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.861301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.861369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.861551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.861630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.861932] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 is going to be created. [ 781.928270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.928359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.928405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.928618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.928784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.942608] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: IN_PROGRESS for 2s [ 783.264947] env[65630]: INFO networking_nsxv3.common.synchronization [req-492f59ce-676a-4a96-8736-ad594212ab8e req-365617b9-b538-4945-aa33-5658185ebb4f tempest-ListServersNegativeTestJSON-1633369316 tempest-ListServersNegativeTestJSON-1633369316-project-member] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 783.266238] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 783.266238] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.266238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.266238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.266482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.267045] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.267045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.267045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.267045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.267045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.267045] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.590026] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: SUCCESS [ 783.590178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.590377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.590696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.590855] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.590983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.591061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.591232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.591321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.591407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.591518] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.646086] env[65630]: INFO networking_nsxv3.common.synchronization [req-334c8704-b2b5-4115-b708-d4e08c32c88e req-d3dbb9a6-73d6-49d6-872a-aad031f9d33f tempest-ServerTagsTestJSON-1698832439 tempest-ServerTagsTestJSON-1698832439-project-member] Enqueued Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_members [ 783.646653] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGHEST for action security_group_members [ 783.647040] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.647184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.647271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.647513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.647673] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.647781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.647839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.648012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.648108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.648207] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.769235] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.955868] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: SUCCESS [ 783.956199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.094984] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.150469] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.150627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.150709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.150955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.153067] env[65630]: INFO networking_nsxv3.common.synchronization [req-21dd8aaf-b85a-4b2c-9c04-06311f38e570 req-b7be9b61-dab1-4739-8692-b3a170a63caa tempest-ListServersNegativeTestJSON-1633369316 tempest-ListServersNegativeTestJSON-1633369316-project-member] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 784.153607] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGHEST for action security_group_members [ 784.154348] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.154488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.190823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.191415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.191578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.191733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.192596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.192758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.192891] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 is going to be updated. [ 784.228562] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.228712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.228757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.228998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.230069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.239530] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 in Status: IN_PROGRESS for 2s [ 784.272928] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.281531] env[65630]: INFO networking_nsxv3.common.synchronization [req-6cf52164-5d35-4772-a76f-9699aa29ec67 req-660698ee-afc7-4e8a-9389-86494362f1ee tempest-ServerRescueTestJSONUnderV235-1063198773 tempest-ServerRescueTestJSONUnderV235-1063198773-project-member] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 784.284326] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGHEST for action security_group_members [ 784.284623] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.284762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.284827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.285080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.285250] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.285355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.285549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.285619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.285665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.285758] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.598958] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3541bfc-04c2-4eba-9579-7dda3fc0388c: rpc.has_security_group_logging(os_id): False [ 784.624455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.624638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.624704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.624940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.625025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.625282] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.625385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.625450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.625690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.625770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.625827] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c is going to be created. [ 784.724026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.724256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.724329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.724579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.724848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.739030] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: IN_PROGRESS for 2s [ 784.784346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.784592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.784721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.784903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.784999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.785130] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 784.787879] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.787879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.787879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.787879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.787879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.788637] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.788637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.788637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.788637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.788637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.788637] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be updated. [ 784.842035] env[65630]: INFO networking_nsxv3.common.synchronization [req-d9a74e7a-ab0e-4e39-b24b-b1769e720ba9 req-8129ead5-3f3c-44dd-8d07-c754f618d169 tempest-ListImageFiltersTestJSON-1975870512 tempest-ListImageFiltersTestJSON-1975870512-project-member] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 784.843961] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.843961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.843961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.844348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.844557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.847663] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 784.850983] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.850983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.850983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.850983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.850983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.853459] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.853570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.853690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.855054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.855054] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.855054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.855054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.855054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.855054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.855054] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.880378] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 784.890016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: IN_PROGRESS for 2s [ 785.359133] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.359478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.359478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.359711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.359828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.360124] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.360191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.360224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.360388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.360468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.360557] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 already deleted. [ 785.360642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.610099] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.610333] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.610597] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.610789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.611084] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.611240] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.611352] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.611569] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.611712] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.611975] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.612072] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.612174] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.612291] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.612361] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.612457] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.612615] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.636489] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.636636] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.636770] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.636945] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.637269] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-b74955e6-8e56-4a39-9b83-bda69a339612 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.637439] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.637551] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.637836] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.637985] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74955e6-8e56-4a39-9b83-bda69a339612',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.141186] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.141595] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.141740] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.142112] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.142296] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.142485] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port b74955e6-8e56-4a39-9b83-bda69a339612 not found, creating... [ 786.142782] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.142961] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.143105] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.143361] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.143514] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.143824] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.143997] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.144142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.144385] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.144534] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.144680] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: b74955e6-8e56-4a39-9b83-bda69a339612 is going to be created. [ 786.168980] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.169180] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.169515] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.169946] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.170224] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.170473] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.248234] env[65630]: INFO networking_nsxv3.common.synchronization [None req-f06ae1d4-c2af-4016-8d7b-c7be3a659e17 None None] Enqueued Resource ID: 3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5 with Priority: HIGHEST for action port [ 786.248234] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5 with Priority: HIGHEST for action port [ 786.248234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.248234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.248234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.248234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.248234] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.253772] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 in Status: SUCCESS [ 786.254034] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 deletion is rescheduled due to dependency. [ 786.254160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.751358] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5 [ 786.751663] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.751789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.751931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.752241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.752344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.753036] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5 already deleted. [ 786.753036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d2b34bf-59a3-4781-97e0-f2cb2ea6b9f5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.753536] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: SUCCESS [ 786.753762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.895108] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 786.896283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.896283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.896402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.896651] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.896819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.896913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.897131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.897598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.897752] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.899556] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 in Status: SUCCESS [ 786.899895] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 deletion is rescheduled due to dependency. [ 786.900586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.967093] env[65630]: INFO networking_nsxv3.common.synchronization [req-d9a74e7a-ab0e-4e39-b24b-b1769e720ba9 req-7e296c03-8e25-47a6-8904-f87465f66bec service nova] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_rules [ 786.967283] env[65630]: INFO networking_nsxv3.common.synchronization [req-d9a74e7a-ab0e-4e39-b24b-b1769e720ba9 req-7e296c03-8e25-47a6-8904-f87465f66bec service nova] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 786.967418] env[65630]: INFO networking_nsxv3.common.synchronization [req-d9a74e7a-ab0e-4e39-b24b-b1769e720ba9 req-7e296c03-8e25-47a6-8904-f87465f66bec service nova] Enqueued Resource ID: b74955e6-8e56-4a39-9b83-bda69a339612 with Priority: HIGHEST for action port [ 786.967966] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_rules [ 786.968819] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 786.968819] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74955e6-8e56-4a39-9b83-bda69a339612 with Priority: HIGHEST for action port [ 786.969140] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.969926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.969926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.969926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.969926] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.971434] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.971558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.971628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.971846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.972010] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.972113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.972176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.972324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.972412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.972583] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.973586] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b74955e6-8e56-4a39-9b83-bda69a339612 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.973689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.973755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.973907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.973980] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74955e6-8e56-4a39-9b83-bda69a339612',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.402516] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.402516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.402516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.402516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.425134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.425483] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.425638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.425755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.425969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.427022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.427022] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be updated. [ 787.451691] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.451869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.451943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.452206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.452359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.461112] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-8229d0ee-cc02-438d-a737-2c6c8830e1f2 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 787.462777] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: IN_PROGRESS for 2s [ 787.463397] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 787.463734] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.464122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.464122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.464233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.464333] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.464391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.464444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.464588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.464673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.464772] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.476052] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.476120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.476302] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.477047] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b74955e6-8e56-4a39-9b83-bda69a339612 with status ACTIVE [ 787.477227] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.477344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.477735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.477735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.477735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.477834] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.477912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.477981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.478132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.478207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.478397] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.478492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.478609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.478689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.478764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.478851] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b74955e6-8e56-4a39-9b83-bda69a339612 is going to be updated. [ 787.504982] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.505152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.505394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.505453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.505592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.505766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b74955e6-8e56-4a39-9b83-bda69a339612" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.856226] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-5bb76a42-ebf4-4caf-a0f3-bc8e5032d3f9 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 787.856226] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 787.856226] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.856226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.968262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.968486] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.968731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.969231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.983906] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.995231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.995541] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.995693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.995755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.995994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.996096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.996203] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 788.023683] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.023830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.023900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.024148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.024297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.033746] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 788.221724] env[65630]: INFO networking_nsxv3.common.synchronization [None req-8fa40a03-f71d-460a-9216-7d77bb9b036f None None] Enqueued Resource ID: f7d4d016-b0db-423e-b8d1-9e3210171bde with Priority: HIGHEST for action port [ 788.221724] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d4d016-b0db-423e-b8d1-9e3210171bde with Priority: HIGHEST for action port [ 788.221724] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d4d016-b0db-423e-b8d1-9e3210171bde taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.222200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d4d016-b0db-423e-b8d1-9e3210171bde" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.222424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d4d016-b0db-423e-b8d1-9e3210171bde" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.223499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d4d016-b0db-423e-b8d1-9e3210171bde" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.223874] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d4d016-b0db-423e-b8d1-9e3210171bde',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.378424] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.378693] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-506" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.378825] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-506" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.379300] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-506" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.379412] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.379569] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.379681] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.379892] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.380481] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.380834] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.381060] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.381125] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.381224] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.381332] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.381547] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.381547] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.406989] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.407158] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.407305] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.407509] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-506" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.407873] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-b21d1d90-ecde-4738-b347-99ed10d1612b taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.408096] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.408269] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.408555] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.408726] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b21d1d90-ecde-4738-b347-99ed10d1612b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.447266] env[65630]: INFO networking_nsxv3.common.synchronization [None req-fc6f3ad2-737d-4350-a367-e8badae860c6 None None] Enqueued Resource ID: 041fc396-c745-4279-bb90-2e3b88342b3c with Priority: HIGHEST for action port [ 788.447902] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041fc396-c745-4279-bb90-2e3b88342b3c with Priority: HIGHEST for action port [ 788.448357] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-041fc396-c745-4279-bb90-2e3b88342b3c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.448357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-041fc396-c745-4279-bb90-2e3b88342b3c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.448556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-041fc396-c745-4279-bb90-2e3b88342b3c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.448885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-041fc396-c745-4279-bb90-2e3b88342b3c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.448885] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('041fc396-c745-4279-bb90-2e3b88342b3c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.487221] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.487410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.487410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.487630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.487726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.487824] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be created. [ 788.525674] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.525871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.525967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.526293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.526499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.538172] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: UNINITIALIZED for 2s [ 788.729672] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7d4d016-b0db-423e-b8d1-9e3210171bde [ 788.731874] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.732130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.732211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.732506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.732627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.732734] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7d4d016-b0db-423e-b8d1-9e3210171bde already deleted. [ 788.732821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d4d016-b0db-423e-b8d1-9e3210171bde" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.911562] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.911985] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.911985] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.912168] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.912318] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.912481] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port b21d1d90-ecde-4738-b347-99ed10d1612b not found, creating... [ 788.912761] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.912918] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.913042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.913328] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.913479] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.913795] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.913960] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.914719] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.915045] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.915219] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.915404] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: b21d1d90-ecde-4738-b347-99ed10d1612b is going to be created. [ 788.946405] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.946405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.946405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.946405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.946405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.946405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.952442] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 041fc396-c745-4279-bb90-2e3b88342b3c [ 788.952683] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.952834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.952906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.953154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.953267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.953357] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:041fc396-c745-4279-bb90-2e3b88342b3c already deleted. [ 788.953424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-041fc396-c745-4279-bb90-2e3b88342b3c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.959269] env[65630]: INFO networking_nsxv3.common.synchronization [req-e37dbdc8-368e-4086-9dfe-1eaac055f26d req-010d63d3-3cf4-4785-968f-34daea69dbd5 tempest-ServerMetadataNegativeTestJSON-1004137549 tempest-ServerMetadataNegativeTestJSON-1004137549-project-member] Enqueued Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_members [ 788.959928] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGHEST for action security_group_members [ 788.960221] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.960349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.960657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.960743] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.960860] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.960959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.961029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.961234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.961329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.961427] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.355757] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 789.355757] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent loop - iteration:1 started [ 789.467034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.467034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.467034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.467034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.481094] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64208df3-7a31-4f66-a25a-21b69af6c4be in Status: SUCCESS [ 789.481094] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be deletion is rescheduled due to dependency. [ 789.481094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.497032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.497032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.497032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.497032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.497032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.497032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.497032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a is going to be updated. [ 789.539225] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.539225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.539225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.539225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.539225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.551379] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a in Status: IN_PROGRESS for 2s [ 789.779536] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-ab7998cd-bff3-49a3-8e1d-94918f9740ff service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 789.779536] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-ab7998cd-bff3-49a3-8e1d-94918f9740ff service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 789.779536] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-ab7998cd-bff3-49a3-8e1d-94918f9740ff service nova] Enqueued Resource ID: b21d1d90-ecde-4738-b347-99ed10d1612b with Priority: HIGHEST for action port [ 789.779536] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 789.779536] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 789.779536] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b21d1d90-ecde-4738-b347-99ed10d1612b with Priority: HIGHEST for action port [ 789.779536] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.779536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.779536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.779536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.779536] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.780681] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.780681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.780865] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b21d1d90-ecde-4738-b347-99ed10d1612b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.780961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.780961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.781280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.781780] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b21d1d90-ecde-4738-b347-99ed10d1612b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.046392] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 790.046668] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 deletion is rescheduled due to dependency. [ 790.046835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.047420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.047698] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.047875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.047973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.048145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.048232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.048334] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.098205] env[65630]: INFO networking_nsxv3.common.synchronization [req-631f1938-08dc-47ea-ab33-723a5e75ca70 req-7b58be7d-7503-4245-9173-1a1bec09818d tempest-ListImageFiltersTestJSON-1975870512 tempest-ListImageFiltersTestJSON-1975870512-project-member] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 790.100343] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 790.101287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.101809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.283909] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.284962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.285990] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b21d1d90-ecde-4738-b347-99ed10d1612b with status ACTIVE [ 790.285990] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.285990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.285990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.286343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.286467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.286704] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.286863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.286963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.287236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.287364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.287794] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.287998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.288241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.288427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.288590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.288762] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b21d1d90-ecde-4738-b347-99ed10d1612b is going to be updated. [ 790.317854] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.318089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.318089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.318344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.318508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.318664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b21d1d90-ecde-4738-b347-99ed10d1612b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.550639] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 790.550978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.551419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.551634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.551883] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.552026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.552109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.552946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.553149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.553368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.553662] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.554952] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.555799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.558866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.558866] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.558866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.558866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.558866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.558866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.558866] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.579710] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.579815] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.579855] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.581043] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.581653] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.581883] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.582045] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.582458] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.582733] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.583553] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.584324] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.584324] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.584554] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.584928] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.585104] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.585502] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.610800] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.610921] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.611069] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.611311] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.611628] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-b92aff3f-1bc6-439c-8e86-e42d4f693b60 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.611795] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.611905] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.612290] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.612437] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92aff3f-1bc6-439c-8e86-e42d4f693b60',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.968643] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.968989] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-737" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.968989] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-737" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.969613] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-737" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.969776] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.969896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.969896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.970243] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.970394] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.970591] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.970701] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.970801] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.970899] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.970999] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.971112] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.971283] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.996823] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.996939] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.997066] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.997301] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-737" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.997604] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-0d127d0a-4946-44e5-a1eb-39513584c01c taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.997797] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.997916] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.998293] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.998481] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d127d0a-4946-44e5-a1eb-39513584c01c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.031052] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1a616d76-f395-4bc2-a605-e54af10f0a7e None None] Enqueued Resource ID: 02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb with Priority: HIGHEST for action port [ 791.032037] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb with Priority: HIGHEST for action port [ 791.032118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.032241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.032312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.032558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.032638] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.060341] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.060799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.060799] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.062034] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.117282] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.117533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.118021] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.118021] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.118122] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.118217] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port b92aff3f-1bc6-439c-8e86-e42d4f693b60 not found, creating... [ 791.118472] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.118633] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.118730] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.118975] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.119137] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.119660] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.119845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.119972] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.120238] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.120400] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.120511] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: b92aff3f-1bc6-439c-8e86-e42d4f693b60 is going to be created. [ 791.142883] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.144018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.144018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.144018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.144018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.144505] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.501272] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.501557] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.501684] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.502020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.502197] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.502357] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 0d127d0a-4946-44e5-a1eb-39513584c01c not found, creating... [ 791.502644] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.502795] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.502904] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.503146] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.503328] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.503685] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.503845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.503954] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.504174] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.504378] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.504441] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 0d127d0a-4946-44e5-a1eb-39513584c01c is going to be created. [ 791.525138] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.525363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.525422] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.525686] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.525901] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.526131] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.534700] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb [ 791.534933] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.535096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.535194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.535436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.535540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.535629] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb already deleted. [ 791.535715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02747dbc-3e94-4ae9-8bd8-98e6f1ac0eeb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.562026] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a in Status: SUCCESS [ 791.562221] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a deletion is rescheduled due to dependency. [ 791.562363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.563816] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.564917] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.565062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.565135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.565923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.565923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.565923] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 791.619118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.619398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.619398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.619866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.619866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.630063] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 791.870700] env[65630]: INFO networking_nsxv3.common.synchronization [req-631f1938-08dc-47ea-ab33-723a5e75ca70 req-b431b9c6-0e74-4302-b7e2-e127ff8cdf5c service nova] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_rules [ 791.870874] env[65630]: INFO networking_nsxv3.common.synchronization [req-631f1938-08dc-47ea-ab33-723a5e75ca70 req-b431b9c6-0e74-4302-b7e2-e127ff8cdf5c service nova] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 791.871016] env[65630]: INFO networking_nsxv3.common.synchronization [req-631f1938-08dc-47ea-ab33-723a5e75ca70 req-b431b9c6-0e74-4302-b7e2-e127ff8cdf5c service nova] Enqueued Resource ID: b92aff3f-1bc6-439c-8e86-e42d4f693b60 with Priority: HIGHEST for action port [ 791.871614] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_rules [ 791.871776] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 791.871925] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b92aff3f-1bc6-439c-8e86-e42d4f693b60 with Priority: HIGHEST for action port [ 791.872382] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.872489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.872726] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.872834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.873058] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b92aff3f-1bc6-439c-8e86-e42d4f693b60 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.873193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.873281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.873593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.873690] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92aff3f-1bc6-439c-8e86-e42d4f693b60',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.067368] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.067731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.067731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.067835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.067931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.068026] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be updated. [ 792.102782] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.105177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.105177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.105177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.105177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.117153] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: IN_PROGRESS for 2s [ 792.270968] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-2ca164a7-d671-4e08-a344-42e28264af40 service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 792.271188] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-2ca164a7-d671-4e08-a344-42e28264af40 service nova] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 792.271408] env[65630]: INFO networking_nsxv3.common.synchronization [req-1c84ac6c-9676-4e30-9acf-f68a893f8260 req-2ca164a7-d671-4e08-a344-42e28264af40 service nova] Enqueued Resource ID: 0d127d0a-4946-44e5-a1eb-39513584c01c with Priority: HIGHEST for action port [ 792.271941] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_rules [ 792.272089] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 792.272200] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d127d0a-4946-44e5-a1eb-39513584c01c with Priority: HIGHEST for action port [ 792.272547] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.272654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.272755] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.272892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.273120] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d127d0a-4946-44e5-a1eb-39513584c01c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.273357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.273442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.273715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.273813] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d127d0a-4946-44e5-a1eb-39513584c01c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.376078] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b92aff3f-1bc6-439c-8e86-e42d4f693b60 with status ACTIVE [ 792.376384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.376717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.376717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.376828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.376828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.377572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.377572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.377572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.377572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.377572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.377572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.377953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.377953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.377953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.377953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.378145] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b92aff3f-1bc6-439c-8e86-e42d4f693b60 is going to be updated. [ 792.406879] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.407072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.407214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.408036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.408036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.408036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b92aff3f-1bc6-439c-8e86-e42d4f693b60" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.698301] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcd1e209-b9b4-45f9-b6be-d03fb2fe95c3 req-a1eda511-4bb2-4844-8e37-526dd0143e5b tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 792.699030] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 792.699251] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.700160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.700160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.700160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.700160] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.700160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.700160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.700478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.700478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.700549] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.776970] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d127d0a-4946-44e5-a1eb-39513584c01c with status ACTIVE [ 792.776970] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.776970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.776970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.777270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.777487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.778739] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.778739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.778739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.778739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.778739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.778739] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.779160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.779160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.779160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.779160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.779356] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d127d0a-4946-44e5-a1eb-39513584c01c is going to be updated. [ 792.801383] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.801551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.801551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.801779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.801928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.802091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d127d0a-4946-44e5-a1eb-39513584c01c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.097612] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.097962] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.098017] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.098402] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.098720] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.098918] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.099162] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.099405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.099584] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.099828] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.099983] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.100156] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.100299] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.100443] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.100591] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.101068] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.125748] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.125927] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.126124] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.126315] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.126645] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-3064719f-e165-4343-8315-98cefa4af9eb taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.126831] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.126961] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.127375] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.127514] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3064719f-e165-4343-8315-98cefa4af9eb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.203389] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.203632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.203697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.204503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.204503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.204503] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.204695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.204695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.205011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.205162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.205345] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 already deleted. [ 793.205533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.629739] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.630086] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.630222] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.630563] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.630901] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.630901] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 3064719f-e165-4343-8315-98cefa4af9eb not found, creating... [ 793.631275] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.631445] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.631570] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.631799] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.631952] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.632343] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.632435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.632508] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.632710] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.632840] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.632976] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 3064719f-e165-4343-8315-98cefa4af9eb is going to be created. [ 793.660647] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 793.661940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.661940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.661940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.661940] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.662441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.662441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.662441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.662441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.662642] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.672403] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.672736] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.672912] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.673354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.673644] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.673992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.128260] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 794.128621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.128677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.128886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.129092] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.129216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.129273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.129445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.129525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.129611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.129772] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.129851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.129900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.130057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.130200] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.130294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.130344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.130487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.130560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.130640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.130726] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.132307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.133949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.133949] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.133949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.133949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.133949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.133949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.133949] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.165392] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.395819] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcd1e209-b9b4-45f9-b6be-d03fb2fe95c3 req-ba566fc9-49d6-4907-a32b-79c16dd30c2a service nova] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 794.396170] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcd1e209-b9b4-45f9-b6be-d03fb2fe95c3 req-ba566fc9-49d6-4907-a32b-79c16dd30c2a service nova] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 794.396499] env[65630]: INFO networking_nsxv3.common.synchronization [req-dcd1e209-b9b4-45f9-b6be-d03fb2fe95c3 req-ba566fc9-49d6-4907-a32b-79c16dd30c2a service nova] Enqueued Resource ID: 3064719f-e165-4343-8315-98cefa4af9eb with Priority: HIGHEST for action port [ 794.397071] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 794.397298] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 794.397404] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3064719f-e165-4343-8315-98cefa4af9eb with Priority: HIGHEST for action port [ 794.397704] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.397831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.397921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.398115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.398212] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.399660] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.399776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.399834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.400019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.400547] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.400685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.400685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.400972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.401080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.401243] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.402840] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3064719f-e165-4343-8315-98cefa4af9eb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.402968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.403047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.404440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.404440] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3064719f-e165-4343-8315-98cefa4af9eb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.636287] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6: rpc.has_security_group_logging(os_id): False [ 794.637585] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.659763] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.659942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.659998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.660212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.660364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.660522] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.660635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.660699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.660883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.661386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.661794] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.661983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.662138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.662412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.662628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.662933] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.663148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.663278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.663527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.663692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.663882] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be created. [ 794.668800] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.737408] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.737408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.737408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.737408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.737896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.750356] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: IN_PROGRESS for 2s [ 794.904042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.904042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.906051] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.906560] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3064719f-e165-4343-8315-98cefa4af9eb with status ACTIVE [ 794.906843] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.907222] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.907319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.910021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.910021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.910021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.911411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.911678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.914776] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3064719f-e165-4343-8315-98cefa4af9eb is going to be updated. [ 794.960741] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.961045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.961045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.962143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.962196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.962407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3064719f-e165-4343-8315-98cefa4af9eb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.140555] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.173088] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.173255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.173327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.173764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.173764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.173847] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 795.227243] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.227438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.227533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.227832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.228101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.239272] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 795.416462] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.457597] env[65630]: INFO networking_nsxv3.common.synchronization [req-886c561d-20ba-4d52-9c1b-0c923f02dc85 req-b5ed2105-01fd-42dd-afac-0d0651485de3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 795.457985] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 795.458351] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.459752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.459847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.460096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.460269] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.460621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.460621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.460621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.460740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.460774] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.645198] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.645479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.645603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.645912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.646111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.646316] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be updated. [ 795.681618] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.681842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.681882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.682113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.682270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.694057] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: IN_PROGRESS for 2s [ 795.920792] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.920987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.921085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.922045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.922045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.922045] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be created. [ 795.968023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.968023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.968023] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 already deleted. [ 795.968023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.968943] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.969756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.970162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.970514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.970921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.985842] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: UNINITIALIZED for 2s [ 796.209061] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.209365] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.209857] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.209857] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.212223] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.217014] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.217014] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.217014] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.217014] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.217014] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.217014] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.217014] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.217014] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.217014] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.217014] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.217014] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.236631] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.236851] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.237079] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.237324] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.237698] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-2b5bb96f-a2a0-48bc-a88d-80a72c840971 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.237879] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.237992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.238392] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.238541] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5bb96f-a2a0-48bc-a88d-80a72c840971',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.740803] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.741043] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.741160] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.741493] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.743384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.743384] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 2b5bb96f-a2a0-48bc-a88d-80a72c840971 not found, creating... [ 796.743384] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.743384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.743384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.743384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.743384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.743384] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.743384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.743384] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.743789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.743789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.743908] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 is going to be created. [ 796.764421] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.765146] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.765146] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.765146] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.765303] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.765525] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.766899] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 796.767115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.767287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.767475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.767563] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.250816] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.255536] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.255536] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.255536] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.255536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.258325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.258325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.258325] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.270069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.270275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.540342] env[65630]: INFO networking_nsxv3.common.synchronization [req-886c561d-20ba-4d52-9c1b-0c923f02dc85 req-f8356f55-bac9-4696-9c33-66a324a59bab service nova] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 797.540521] env[65630]: INFO networking_nsxv3.common.synchronization [req-886c561d-20ba-4d52-9c1b-0c923f02dc85 req-f8356f55-bac9-4696-9c33-66a324a59bab service nova] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 797.540651] env[65630]: INFO networking_nsxv3.common.synchronization [req-886c561d-20ba-4d52-9c1b-0c923f02dc85 req-f8356f55-bac9-4696-9c33-66a324a59bab service nova] Enqueued Resource ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with Priority: HIGHEST for action port [ 797.541199] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 797.541434] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 797.541559] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with Priority: HIGHEST for action port [ 797.541868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.542029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.542090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.542408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.542479] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.543749] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.543863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.543930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.544161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.544330] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.544413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.544474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.544628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.544717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.544808] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.545672] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5bb96f-a2a0-48bc-a88d-80a72c840971 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.545782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.545923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.546014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.546118] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5bb96f-a2a0-48bc-a88d-80a72c840971',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.705370] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 797.705612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.705746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.706063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.706231] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.706364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.706432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.706751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.706751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.706889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.706889] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.758016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.758268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.758886] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.009036] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 798.009270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.009400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.009724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.010007] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.010186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.010285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.010513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.010738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.010900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.012871] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.048241] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.048476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.054235] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.055555] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with status ACTIVE [ 798.055848] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.056071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.056188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.056452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.056587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.056787] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.056911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.056989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.059663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.059923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.060309] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.060508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.060508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.060685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.060775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.060849] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 is going to be updated. [ 798.110262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.110262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.110262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.110262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.110262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.110262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.209880] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.210183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.210282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.210653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.210723] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.210829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.210893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.211078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.211200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.211405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.211603] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.211744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.211832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.212088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.212542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.212673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.212741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.212906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.212992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.213093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.213190] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.262672] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.384099] env[65630]: INFO networking_nsxv3.common.synchronization [req-5f77da5d-d786-4191-bbf9-35854d187277 req-6a84273d-12fd-4988-8b5a-a6596eb66c14 tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 798.384099] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 798.384099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.384099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.384099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.384454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.384454] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.384454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.384578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.385355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.385355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.385355] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.520015] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.563685] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.715882] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6: rpc.has_security_group_logging(os_id): False [ 798.745277] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.745277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.745277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.745277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.745611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.745611] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.745695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.745781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.745947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.746052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.746271] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.746499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.746499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.746685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.746760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.746965] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.747559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.747648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.747824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.747915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.748077] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be updated. [ 798.768183] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.768295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.768698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.768698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.768698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.768698] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 798.801179] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.801179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.801179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.801370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.801879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.815510] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 798.836362] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.836362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.836362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.836362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.836362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.851988] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: IN_PROGRESS for 2s [ 798.888405] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.888574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.888646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.888900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.888951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.890169] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.890169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.890169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.890169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.890169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.890169] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef already deleted. [ 798.890169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.016633] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.016937] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.017101] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.017528] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.017896] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.018103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.018294] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.018545] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.018769] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.019097] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.019268] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.019420] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.019566] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.019715] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.019832] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.020057] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.021895] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bee721e8-67ba-4959-8884-95efeb9d52b8: rpc.has_security_group_logging(os_id): False [ 799.044708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.044980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.045127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.045462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.045587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.045998] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.046196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.046298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.046575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.046690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.046792] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be created. [ 799.054551] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.054751] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.054885] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.055095] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.055424] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-3f627480-fbb1-4e82-9ff5-65edda7ba80e taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.055595] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.055725] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.056087] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.056261] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f627480-fbb1-4e82-9ff5-65edda7ba80e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.065487] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.065645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.065696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.065926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.066123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.066123] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be created. [ 799.095315] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.095477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.095570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.095752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.096039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.118981] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: UNINITIALIZED for 2s [ 799.142592] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.142831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.142831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.143252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.143252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.167963] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 799.558781] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.559250] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.559250] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.559485] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.559639] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.559883] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 3f627480-fbb1-4e82-9ff5-65edda7ba80e not found, creating... [ 799.560179] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.560338] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.560454] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.560710] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.560843] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.561139] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.561357] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.561473] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.561678] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.561806] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.561957] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 3f627480-fbb1-4e82-9ff5-65edda7ba80e is going to be created. [ 799.584409] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.584660] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.584727] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.584999] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.585270] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.585532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.946490] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b868f088-df5c-4256-a8db-128a2a982af0 None None] Enqueued Resource ID: 3fd71496-c63a-4223-b184-671126359ac1 with Priority: HIGHEST for action port [ 799.947284] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd71496-c63a-4223-b184-671126359ac1 with Priority: HIGHEST for action port [ 799.947488] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd71496-c63a-4223-b184-671126359ac1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.947636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd71496-c63a-4223-b184-671126359ac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.947708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd71496-c63a-4223-b184-671126359ac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.948087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd71496-c63a-4223-b184-671126359ac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.948185] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd71496-c63a-4223-b184-671126359ac1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.264099] env[65630]: INFO networking_nsxv3.common.synchronization [req-5f77da5d-d786-4191-bbf9-35854d187277 req-d5f0fbf6-aa61-4ad1-bfbf-951d038acdc0 service nova] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_rules [ 800.264301] env[65630]: INFO networking_nsxv3.common.synchronization [req-5f77da5d-d786-4191-bbf9-35854d187277 req-d5f0fbf6-aa61-4ad1-bfbf-951d038acdc0 service nova] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 800.264468] env[65630]: INFO networking_nsxv3.common.synchronization [req-5f77da5d-d786-4191-bbf9-35854d187277 req-d5f0fbf6-aa61-4ad1-bfbf-951d038acdc0 service nova] Enqueued Resource ID: 3f627480-fbb1-4e82-9ff5-65edda7ba80e with Priority: HIGHEST for action port [ 800.265028] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_rules [ 800.265574] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 800.265694] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f627480-fbb1-4e82-9ff5-65edda7ba80e with Priority: HIGHEST for action port [ 800.265988] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.266135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.266198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.266459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.266541] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.267657] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.267767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.267830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.268576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.268576] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.268576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.268576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.268576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.268777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.268777] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.271463] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f627480-fbb1-4e82-9ff5-65edda7ba80e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.271463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.271463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.271463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.271463] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f627480-fbb1-4e82-9ff5-65edda7ba80e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.451540] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fd71496-c63a-4223-b184-671126359ac1 [ 800.451833] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.452052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.456021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.456021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.456021] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fd71496-c63a-4223-b184-671126359ac1 already deleted. [ 800.456021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd71496-c63a-4223-b184-671126359ac1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.627760] env[65630]: INFO networking_nsxv3.common.synchronization [req-330b114c-4e46-4b8c-93e8-6311b8bc4b5b req-2f614bfc-ab18-47ea-ade2-a2056ef000f4 tempest-AttachInterfacesV270Test-858361944 tempest-AttachInterfacesV270Test-858361944-project-member] Enqueued Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_members [ 800.628342] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGHEST for action security_group_members [ 800.628645] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.629172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.629172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.629172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.629332] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.629383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.629426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.629592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.629673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.629765] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.771824] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.773262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.773506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.775828] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f627480-fbb1-4e82-9ff5-65edda7ba80e with status ACTIVE [ 800.775828] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.775828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.775980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.776369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.776369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.777979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.777979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.777979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.778471] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f627480-fbb1-4e82-9ff5-65edda7ba80e is going to be updated. [ 800.804906] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.805136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.805238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.805546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.805823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.806902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f627480-fbb1-4e82-9ff5-65edda7ba80e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.830841] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 800.831191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.831453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.831752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.832026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.832203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.832328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.832526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.832646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.832767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.832994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.835373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.835757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.835987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.837324] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.837324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.837324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.837324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.837324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.837324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.837324] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.880862] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 800.880862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.128935] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 801.129205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.129458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.129925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.130743] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.130948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.131304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.131304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.131422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.131422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.131505] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.133619] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.133784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.134025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.134073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.134584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.134584] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.134584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.134584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.134972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.134972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.134972] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 is going to be updated. [ 801.162118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.162380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.162507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.162734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.162879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.174474] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 in Status: IN_PROGRESS for 2s [ 801.179335] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 801.179540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.275706] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.340550] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 250f01a9-6e9d-4438-a22e-10b77875cd34: rpc.has_security_group_logging(os_id): False [ 801.363530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.363530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.363530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.363530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.364206] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.364206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.364206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.364206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.364206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.364206] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 801.441118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.441331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.441331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.442240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.442240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.457071] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 801.638442] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.638442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.638442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.638442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.638442] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.638442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.638442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.638884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.638884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.638884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.639026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.639026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.639105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.639414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.639414] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.639594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.639594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.639659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.639739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.639819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.639907] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.778854] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.778939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.778994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.779247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.779337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.779452] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be created. [ 801.805124] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.805364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.805364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.806764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.806975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.819212] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: UNINITIALIZED for 2s [ 802.084529] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6453b238-4146-4262-9f6e-367d096ce6a2 None None] Enqueued Resource ID: a6bcf66e-f09d-46cd-8f05-3bf1e76fb411 with Priority: HIGHEST for action port [ 802.084529] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bcf66e-f09d-46cd-8f05-3bf1e76fb411 with Priority: HIGHEST for action port [ 802.084529] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6bcf66e-f09d-46cd-8f05-3bf1e76fb411 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.084529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6bcf66e-f09d-46cd-8f05-3bf1e76fb411" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.084529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6bcf66e-f09d-46cd-8f05-3bf1e76fb411" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.085470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6bcf66e-f09d-46cd-8f05-3bf1e76fb411" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.085612] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6bcf66e-f09d-46cd-8f05-3bf1e76fb411',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.146485] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a73db6d-e930-47a9-9dbe-748ef759f251: rpc.has_security_group_logging(os_id): False [ 802.166167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.166344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.166399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.166598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.166689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.166897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.166996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.167086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.167224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.167297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.167472] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.167567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.167632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.167782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.167895] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.168053] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.168166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.168206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.168344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.168410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.168495] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be created. [ 802.244280] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.246880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.246880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.246880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.246880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.259458] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 802.593043] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6bcf66e-f09d-46cd-8f05-3bf1e76fb411 [ 802.593043] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.593043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.593043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.593043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.593043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.593043] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6bcf66e-f09d-46cd-8f05-3bf1e76fb411 already deleted. [ 802.593043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6bcf66e-f09d-46cd-8f05-3bf1e76fb411" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.187347] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 in Status: SUCCESS [ 803.187723] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 deletion is rescheduled due to dependency. [ 803.187723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.480015] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 803.480015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.480015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.480015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.480015] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.831242] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 803.831555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.831773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.831987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.832194] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.832316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.832382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.832532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.832642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.832750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.832848] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.983748] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.983949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.984069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.984333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.984522] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.984632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.984698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.984863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.984953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.985057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.985150] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.278725] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 804.279072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.336670] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.336822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.336900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.337179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.337353] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.337500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.337538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.337681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.337769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.337861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.338034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.338159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.338224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.338381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.338548] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.338648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.338709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.338835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.338915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.338999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.339105] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.488671] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.488926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.489024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.489372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.489577] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.489687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.489752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.489924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.490021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.490115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.490319] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.490391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.490427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.490579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.490753] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.490811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.490891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.491049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.491126] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.491210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.491334] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.842748] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59e543f5-3a08-4982-8918-ea2593f725ef: rpc.has_security_group_logging(os_id): False [ 804.864676] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.864817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.864894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.866916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.867071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.867312] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.867436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.867492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.867719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.867835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.868066] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.868167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.868226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.868385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.868454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.868665] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.868747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.868808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.868949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.869054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.869112] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be created. [ 804.935789] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.936930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.936930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.936930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.939671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.954838] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 804.997104] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 250f01a9-6e9d-4438-a22e-10b77875cd34: rpc.has_security_group_logging(os_id): False [ 805.047191] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.047191] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.047191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.047191] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.047921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.047921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.047921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.047921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.047921] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.048105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.049136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.049352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.049444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.049542] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 805.165071] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.165262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.165347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.165896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.165896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.192851] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 806.774648] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a44ddc51-59a1-46a1-9bd6-86dd3e3163d8 None None] Enqueued Resource ID: 91938e20-6de6-4b8d-bef2-96f86f57f501 with Priority: HIGHEST for action port [ 806.778384] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91938e20-6de6-4b8d-bef2-96f86f57f501 with Priority: HIGHEST for action port [ 806.778541] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-91938e20-6de6-4b8d-bef2-96f86f57f501 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.778694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91938e20-6de6-4b8d-bef2-96f86f57f501" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.778775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91938e20-6de6-4b8d-bef2-96f86f57f501" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.779127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91938e20-6de6-4b8d-bef2-96f86f57f501" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.779238] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91938e20-6de6-4b8d-bef2-96f86f57f501',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.969414] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 806.970094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.229500] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 807.229715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.283735] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91938e20-6de6-4b8d-bef2-96f86f57f501 [ 807.283735] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.283735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.283917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.283993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.284092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.284187] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91938e20-6de6-4b8d-bef2-96f86f57f501 already deleted. [ 807.284354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91938e20-6de6-4b8d-bef2-96f86f57f501" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.742139] env[65630]: INFO networking_nsxv3.common.synchronization [req-461b1c07-23d4-4422-9a64-c682f77eb6a3 req-032cf7ae-c1ac-467f-a7c3-33c61b3ee24a tempest-ServersAdminNegativeTestJSON-2028070641 tempest-ServersAdminNegativeTestJSON-2028070641-project-member] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 808.748364] env[65630]: INFO networking_nsxv3.common.synchronization [req-8452933f-998c-47b0-b5ab-c5197194d328 req-2333dff3-0604-4e63-babb-43c709e0849f tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 808.749046] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGHEST for action security_group_members [ 808.749201] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 808.749989] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.750141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.750186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.750400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.750574] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.750648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.750706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.750867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.751062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.751062] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.752026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.752941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.752941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.752941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.752941] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.752941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.752941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.752941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.752941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.753232] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.104412] env[65630]: INFO networking_nsxv3.common.synchronization [req-8452933f-998c-47b0-b5ab-c5197194d328 req-24ef371f-4b2a-4bb2-bde4-e9c04ba25d68 tempest-ServersTestMultiNic-120193027 tempest-ServersTestMultiNic-120193027-project-member] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 809.104977] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGHEST for action security_group_members [ 809.105500] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.105624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.256220] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.256220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.256220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.256477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.259897] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.288300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.288720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.288889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.288995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.289290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.289445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.289584] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be updated. [ 809.329277] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.329460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.329512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.329814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.330014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.342240] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: IN_PROGRESS for 2s [ 809.461068] env[65630]: INFO networking_nsxv3.common.synchronization [req-5adc6cc0-1f04-4aa2-a65d-813ab3e5f010 req-62abd896-a786-47f1-be59-e98e7cfcfa70 tempest-ImagesOneServerTestJSON-610554714 tempest-ImagesOneServerTestJSON-610554714-project-member] Enqueued Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_members [ 809.461920] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d with Priority: HIGHEST for action security_group_members [ 809.462790] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.464259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.464337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.464561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.464735] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.464840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.464898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.465077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.465166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.465551] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.763689] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.918197] env[65630]: INFO networking_nsxv3.common.synchronization [None req-4b06d1a4-f571-4952-bd70-19c57479c283 None None] Enqueued Resource ID: 945c22e5-81df-429d-9021-601c32edbafe with Priority: HIGHEST for action port [ 809.918780] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 945c22e5-81df-429d-9021-601c32edbafe with Priority: HIGHEST for action port [ 809.919091] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-945c22e5-81df-429d-9021-601c32edbafe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.920789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-945c22e5-81df-429d-9021-601c32edbafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.920862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-945c22e5-81df-429d-9021-601c32edbafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.921120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-945c22e5-81df-429d-9021-601c32edbafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.921205] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('945c22e5-81df-429d-9021-601c32edbafe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.969891] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.970110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.970172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.970372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.005378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.005378] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.005378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.005378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.005378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.008041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.008041] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d is going to be updated. [ 810.062437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.064914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.064914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.064914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.064914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.085462] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d in Status: IN_PROGRESS for 2s [ 810.269642] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.269913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.270021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.270332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.270369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.270557] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 810.312064] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.312064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.312422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.312850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.314146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.326033] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 810.424215] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 945c22e5-81df-429d-9021-601c32edbafe [ 810.424293] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.424433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.424504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.424734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.424827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.424974] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:945c22e5-81df-429d-9021-601c32edbafe already deleted. [ 810.425080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-945c22e5-81df-429d-9021-601c32edbafe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.360472] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b in Status: SUCCESS [ 811.360793] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b deletion is rescheduled due to dependency. [ 811.360793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.465042] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e7dd4de0-0e59-46be-9f70-400317b3fff4 tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 6e246831-2a35-4e05-8fac-b382ab56343d with Priority: HIGHEST for action security_group_rules [ 811.465888] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e246831-2a35-4e05-8fac-b382ab56343d with Priority: HIGHEST for action security_group_rules [ 811.466940] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e246831-2a35-4e05-8fac-b382ab56343d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.467124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.467197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.467556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.467661] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e246831-2a35-4e05-8fac-b382ab56343d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.745483] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6a24f319-5144-4ccc-aab6-ae8916c36d2e tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 6e246831-2a35-4e05-8fac-b382ab56343d with Priority: HIGHEST for action security_group_rules [ 811.746904] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e246831-2a35-4e05-8fac-b382ab56343d with Priority: HIGHEST for action security_group_rules [ 811.747334] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e246831-2a35-4e05-8fac-b382ab56343d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.747460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.903964] env[65630]: INFO networking_nsxv3.common.synchronization [req-b6d45eff-d70a-4d07-ab4f-c9b15844ac9d req-94be01f4-97e6-4b23-bc5f-7bb5039388a6 tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 811.904696] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 811.904970] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.905677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.905895] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.906255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.906443] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.906559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.906625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.906795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.906877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.906969] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.990551] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.990725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.990822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.991091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.991253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.991310] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e246831-2a35-4e05-8fac-b382ab56343d already deleted. [ 811.991423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.991670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.991804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.992210] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e246831-2a35-4e05-8fac-b382ab56343d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.100507] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d in Status: SUCCESS [ 812.100694] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d deletion is rescheduled due to dependency. [ 812.100893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.211274] env[65630]: INFO networking_nsxv3.common.synchronization [req-04669286-9081-4e6a-aca6-6d826adad671 req-373c862b-8df3-4f0f-b7dd-15dcedffb1b3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 812.211835] env[65630]: INFO networking_nsxv3.common.synchronization [req-04669286-9081-4e6a-aca6-6d826adad671 req-373c862b-8df3-4f0f-b7dd-15dcedffb1b3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 812.213662] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 812.213884] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 812.214279] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.214533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.214533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.214754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.214971] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.215115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.215175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.219480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.219619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.219714] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.220950] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.221163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.221163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.221514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.222803] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.222803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.222803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.222803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.222803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.222803] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.282277] env[65630]: INFO networking_nsxv3.common.synchronization [req-04669286-9081-4e6a-aca6-6d826adad671 req-373c862b-8df3-4f0f-b7dd-15dcedffb1b3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_rules [ 812.282496] env[65630]: INFO networking_nsxv3.common.synchronization [req-04669286-9081-4e6a-aca6-6d826adad671 req-373c862b-8df3-4f0f-b7dd-15dcedffb1b3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 812.282631] env[65630]: INFO networking_nsxv3.common.synchronization [req-04669286-9081-4e6a-aca6-6d826adad671 req-373c862b-8df3-4f0f-b7dd-15dcedffb1b3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 812.282756] env[65630]: INFO networking_nsxv3.common.synchronization [req-04669286-9081-4e6a-aca6-6d826adad671 req-373c862b-8df3-4f0f-b7dd-15dcedffb1b3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 812.282914] env[65630]: INFO networking_nsxv3.common.synchronization [req-04669286-9081-4e6a-aca6-6d826adad671 req-373c862b-8df3-4f0f-b7dd-15dcedffb1b3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with Priority: HIGHEST for action port [ 812.283693] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_rules [ 812.283977] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 812.284357] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with Priority: HIGHEST for action port [ 812.284519] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 812.284652] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 812.285041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.285191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.285249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.285596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.285677] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.287750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.287750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.287750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.287750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.287750] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.288326] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5bb96f-a2a0-48bc-a88d-80a72c840971 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.288464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.288532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.288723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.288866] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5bb96f-a2a0-48bc-a88d-80a72c840971',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.289810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.289933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.290619] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.290619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.339855] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 812.340098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.340288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.340860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.341028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.341208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.341301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.341601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.342042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.342042] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.409820] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.515435] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.515730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.515730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.515896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.515952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.516068] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e246831-2a35-4e05-8fac-b382ab56343d already deleted. [ 812.518153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e246831-2a35-4e05-8fac-b382ab56343d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.637164] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.637433] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.637659] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.638046] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.638726] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.638726] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.638726] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.639015] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.639185] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.639417] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.639527] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.639629] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.639729] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.639832] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.639929] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.640091] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.663387] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.663387] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 812.663387] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.663634] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.664099] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-3bbc5c60-4af7-45b7-8131-5782d4804866 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.664385] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.664714] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.665147] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.665510] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bbc5c60-4af7-45b7-8131-5782d4804866',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.724979] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.728441] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.793690] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.793690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.793690] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with status ACTIVE [ 812.793690] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.793690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.793690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.793690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.794062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.794454] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.794454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.794454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.794683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.794828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.796141] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.796251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.796321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.796549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.796638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.796730] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 is going to be updated. [ 812.798041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.798143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.822444] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.822638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.822699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.822959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.823134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.823316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.845278] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.845530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.845636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.845885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.845980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.846264] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.846378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.846478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.846720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.846850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.846976] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be updated. [ 812.879167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.879433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.879579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.879919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.880152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.908482] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: IN_PROGRESS for 2s [ 812.915224] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.169206] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.169206] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.169206] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.169206] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.169206] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.169720] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 3bbc5c60-4af7-45b7-8131-5782d4804866 not found, creating... [ 813.169720] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.169720] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.169871] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.170130] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.170279] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.170641] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.170785] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.170999] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.171162] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.171273] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.171464] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 3bbc5c60-4af7-45b7-8131-5782d4804866 is going to be created. [ 813.198556] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.198934] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.199065] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.199513] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.199899] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.200419] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.228171] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.230462] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.418286] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.418704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.418704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.418776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.418847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.418950] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be updated. [ 813.449288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.449524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.449571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.449812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.449973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.464646] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 813.730760] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.730962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.731018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.731466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.731574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.731726] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 813.733918] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.734104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.734323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.734609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.734737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.734870] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be created. [ 813.768568] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.768777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.768921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.769287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.769532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.781810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.781992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.782834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.782834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.782834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.784934] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: UNINITIALIZED for 2s [ 813.793381] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 814.008026] env[65630]: INFO networking_nsxv3.common.synchronization [req-b6d45eff-d70a-4d07-ab4f-c9b15844ac9d req-da8b3831-e898-4cd6-9daf-d50d9766cafb service nova] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_rules [ 814.008026] env[65630]: INFO networking_nsxv3.common.synchronization [req-b6d45eff-d70a-4d07-ab4f-c9b15844ac9d req-da8b3831-e898-4cd6-9daf-d50d9766cafb service nova] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 814.008026] env[65630]: INFO networking_nsxv3.common.synchronization [req-b6d45eff-d70a-4d07-ab4f-c9b15844ac9d req-da8b3831-e898-4cd6-9daf-d50d9766cafb service nova] Enqueued Resource ID: 3bbc5c60-4af7-45b7-8131-5782d4804866 with Priority: HIGHEST for action port [ 814.008026] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_rules [ 814.008026] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 814.008026] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbc5c60-4af7-45b7-8131-5782d4804866 with Priority: HIGHEST for action port [ 814.008026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.008026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.008026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.008026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.008026] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.010442] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.013043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.013043] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bbc5c60-4af7-45b7-8131-5782d4804866 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.013043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.013043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.013043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.013043] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bbc5c60-4af7-45b7-8131-5782d4804866',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.514706] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.515048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.516269] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bbc5c60-4af7-45b7-8131-5782d4804866 with status ACTIVE [ 814.516415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.516534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.516598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.516809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.516928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.517210] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.517210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.517305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.517412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.517482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.517624] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.517716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.517777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.517939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.518083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.518179] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bbc5c60-4af7-45b7-8131-5782d4804866 is going to be updated. [ 814.543474] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.543707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.543823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.543960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.544119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.544379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bbc5c60-4af7-45b7-8131-5782d4804866" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.909960] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7b9bd9be-f06c-4a17-b54f-d79ac38b056d None None] Enqueued Resource ID: bc7a7282-040e-444a-b048-3f02242541e7 with Priority: HIGHEST for action port [ 814.912210] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7a7282-040e-444a-b048-3f02242541e7 with Priority: HIGHEST for action port [ 814.912695] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc7a7282-040e-444a-b048-3f02242541e7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.912869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc7a7282-040e-444a-b048-3f02242541e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.912969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc7a7282-040e-444a-b048-3f02242541e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.913368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc7a7282-040e-444a-b048-3f02242541e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.913493] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7a7282-040e-444a-b048-3f02242541e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.924010] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 in Status: SUCCESS [ 814.924288] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 deletion is rescheduled due to dependency. [ 814.924444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.416426] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc7a7282-040e-444a-b048-3f02242541e7 [ 815.416426] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.416426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.416426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.416837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.416837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.416906] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc7a7282-040e-444a-b048-3f02242541e7 already deleted. [ 815.416955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc7a7282-040e-444a-b048-3f02242541e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.479029] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 815.479029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.479029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.479029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.479029] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.479029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.479029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.479029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.479029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.479029] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.797051] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 815.797051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.797051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.797051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.797051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.797051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.797051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.797582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.797582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.797582] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.807081] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 815.807356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.807811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.808032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.808229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.808343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.808409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.808555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.808640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.808760] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.981504] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.300547] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.311791] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.483731] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.804702] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.813451] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.986510] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.986688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.986753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.986965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.987490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.987490] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be updated. [ 817.027833] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.028132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.028268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.028471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.028645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.037977] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 817.180535] env[65630]: INFO networking_nsxv3.common.synchronization [None req-40141363-28c6-47ed-a61b-341d0725e1bc None None] Enqueued Resource ID: a0afc565-fbb9-467b-8ad0-cf6a810bf80a with Priority: HIGHEST for action port [ 817.181104] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0afc565-fbb9-467b-8ad0-cf6a810bf80a with Priority: HIGHEST for action port [ 817.181551] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0afc565-fbb9-467b-8ad0-cf6a810bf80a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.181683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0afc565-fbb9-467b-8ad0-cf6a810bf80a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.181683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0afc565-fbb9-467b-8ad0-cf6a810bf80a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.181954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0afc565-fbb9-467b-8ad0-cf6a810bf80a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.182042] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0afc565-fbb9-467b-8ad0-cf6a810bf80a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.306709] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.307127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.307127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.307284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.307750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.307750] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be updated. [ 817.315587] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.315821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.315870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.316119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.316204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.316310] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 817.348391] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.348667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.348812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.349109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.349261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.351683] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.351831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.351877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.352260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.352491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.364013] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: IN_PROGRESS for 2s [ 817.364750] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 817.685417] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0afc565-fbb9-467b-8ad0-cf6a810bf80a [ 817.685660] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.685799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.685864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.686112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.686200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.686300] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0afc565-fbb9-467b-8ad0-cf6a810bf80a already deleted. [ 817.686404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0afc565-fbb9-467b-8ad0-cf6a810bf80a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.048614] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 819.049068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.049116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.049483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.049755] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.049938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.050051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.050303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.050464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.050644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.050769] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.375874] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 819.376341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.376994] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 819.377467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.377467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.378306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.378306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.378306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.378306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.378574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.378934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.378934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.379037] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.379916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.380147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.380363] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.380482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.380586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.380770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.380873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.380961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.381096] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.553511] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.553660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.553766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.554202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.554266] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.554383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.554460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.554648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.554739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.554829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.554989] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.555134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.555221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.555421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.555603] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.555666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.555723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.555953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.556026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.556159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.556214] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.883449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.883671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.883803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.884708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.884708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.884708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.884708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.884708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.884708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.884708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.884708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.885071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.885071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.885071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.885166] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.885218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.885277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.885424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.885484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.885573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.885660] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.886560] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.060237] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59e543f5-3a08-4982-8918-ea2593f725ef: rpc.has_security_group_logging(os_id): False [ 820.074632] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 820.074697] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_members [ 820.074893] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 820.075339] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 820.075481] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_members [ 820.075582] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 820.075895] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.076046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.076119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.076303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.076460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.076556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.076609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.076778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.076863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.076952] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.078199] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b25fb6e-f742-4dda-bb8b-ad33a402286e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.080197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.080197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.080197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.080197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.080197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.080197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.080197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.080197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.080868] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.081420] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.081534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.081598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.081760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.081906] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.082023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.082388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.082388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.082388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.082388] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.085412] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.085579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.085579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.085803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.085803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.089027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.089027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.089027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.089027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.089649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.089649] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be updated. [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_rules [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_members [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_rules [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [req-f50d42e0-b2ad-45e7-8041-52c6d7daf40d req-b93d2aad-c584-45ea-ad18-100889b98587 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with Priority: HIGHEST for action port [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_rules [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_rules [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with Priority: HIGHEST for action port [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_members [ 820.136034] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 820.136034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b25fb6e-f742-4dda-bb8b-ad33a402286e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.136954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.136954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.136954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.137073] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.141630] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.141769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.141987] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.142082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.142267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5bb96f-a2a0-48bc-a88d-80a72c840971 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.142364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.142446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.142659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.142735] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5bb96f-a2a0-48bc-a88d-80a72c840971',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.144025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.144025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.144025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b25fb6e-f742-4dda-bb8b-ad33a402286e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.144234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.144694] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.144694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.164952] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.165122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.165193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.165802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.165802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.193599] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 820.388382] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a73db6d-e930-47a9-9dbe-748ef759f251: rpc.has_security_group_logging(os_id): False [ 820.390209] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 129b80e0-f31c-48f3-b8cb-02ada0d90df9: rpc.has_security_group_logging(os_id): False [ 820.409504] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.410625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.410625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.410625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.410625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.410625] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.410927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.410927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.411113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.411218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.411329] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be created. [ 820.413274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.413500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.413690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.413786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.413887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.414158] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.415018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.415018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.415018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.415018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.415018] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.415018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.415018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.415018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.415314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.415503] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.415647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.415722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.415913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.416021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.416147] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 820.506295] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.506295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.506295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.506295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.507984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.510575] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.510747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.510927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.511231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.511383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.531581] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: IN_PROGRESS for 2s [ 820.537600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 820.584441] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.586014] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.592860] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.646559] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b25fb6e-f742-4dda-bb8b-ad33a402286e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.646785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.646920] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b5bb96f-a2a0-48bc-a88d-80a72c840971 with status ACTIVE [ 820.647082] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.647212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.647289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.647526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.647983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.647983] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.647983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.647983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.648208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.648208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.648383] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.648471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.648534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.648680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.648758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.648842] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b5bb96f-a2a0-48bc-a88d-80a72c840971 is going to be updated. [ 820.671157] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.671308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.671371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.671651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.671794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.672032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5bb96f-a2a0-48bc-a88d-80a72c840971" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.094468] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.095563] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.097870] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.391325] env[65630]: INFO networking_nsxv3.common.synchronization [None req-ef564c31-8d36-47ec-9c26-4674097a187f tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 821.395739] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 821.396489] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.396844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.396844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.397197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.397342] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.544283] env[65630]: INFO networking_nsxv3.common.synchronization [None req-98fd49d8-2041-495a-9326-b763956c9499 tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 821.544546] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 821.545093] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.545381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.604409] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.604409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.604409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.604409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.604409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.604409] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e is going to be created. [ 821.604409] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.604409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.604409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.604409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.606918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.606918] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 821.610020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.610020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.610020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.610020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.610020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.610020] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be updated. [ 821.656426] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.656581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.656942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.656942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.657067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.660373] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.660682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.660682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.660941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.661151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.663568] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.663749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.663862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.664092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.664258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.671621] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: UNINITIALIZED for 2s [ 821.672980] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: IN_PROGRESS for 2s [ 821.676521] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 821.928818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.929035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.929151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.931357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.931357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.931357] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 already deleted. [ 821.931357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.931357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.931357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.931357] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.207562] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 822.207935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.455707] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.455707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.455707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.455707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.455707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.455707] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 already deleted. [ 822.455707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.549116] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 822.549402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.549975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.550245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.550348] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.555538] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 822.556139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.556139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.556139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.556139] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.055898] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.057137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.063891] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.063891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.683359] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 823.685986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.685986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.685986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.685986] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.685986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.685986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.685986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.685986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.685986] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.691037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: SUCCESS [ 823.691037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.691037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 823.691037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.691522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.691522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.691598] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.693038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.693038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.693038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.693038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.693038] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.693038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.693448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.693448] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.693448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.693448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.694112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.694112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.694112] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.195423] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.196904] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.198282] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.699156] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.700991] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.703017] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.203699] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.203920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.203999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.204344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.204483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.204635] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be updated. [ 825.206655] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.206822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.206920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.207196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.207313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.207856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e is going to be updated. [ 825.209265] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.209499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.209615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.209966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.210098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.210203] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 825.272903] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.272903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.272903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.273183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.273431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.276581] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.276741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.276775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.276968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.277120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.279440] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.279576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.279646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.279842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.279973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.299647] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: IN_PROGRESS for 2s [ 825.300435] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 825.301056] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: IN_PROGRESS for 2s [ 825.927889] env[65630]: INFO networking_nsxv3.common.synchronization [None req-349fcac3-4f66-45bc-9114-d92acd49a050 None None] Enqueued Resource ID: 693ec0e6-127a-4b40-8874-c6305db31860 with Priority: HIGHEST for action port [ 825.928424] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 693ec0e6-127a-4b40-8874-c6305db31860 with Priority: HIGHEST for action port [ 825.928853] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-693ec0e6-127a-4b40-8874-c6305db31860 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.928853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-693ec0e6-127a-4b40-8874-c6305db31860" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.929015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-693ec0e6-127a-4b40-8874-c6305db31860" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.929396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-693ec0e6-127a-4b40-8874-c6305db31860" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.930135] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('693ec0e6-127a-4b40-8874-c6305db31860',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.434036] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 693ec0e6-127a-4b40-8874-c6305db31860 [ 826.434036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.434036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.434036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.434036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.434303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.434303] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:693ec0e6-127a-4b40-8874-c6305db31860 already deleted. [ 826.434303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-693ec0e6-127a-4b40-8874-c6305db31860" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.812263] env[65630]: INFO networking_nsxv3.common.synchronization [req-31b0aa05-33d7-4413-b48d-c7ce12865073 req-1ae0d00e-8baf-47e0-82ca-6692953cbc04 tempest-DeleteServersAdminTestJSON-1326035621 tempest-DeleteServersAdminTestJSON-1326035621-project-member] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 826.812969] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 826.813660] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.813866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.813921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.814217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.814398] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.814508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.814561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.814770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.814898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.815017] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.315443] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 827.315443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.315443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.315842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.315842] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.315842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.315954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.316929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.316929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.316929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.316929] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.320650] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 827.320848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.321671] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: SUCCESS [ 827.321843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.322446] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.322594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.322665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.323227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.323227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.323227] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.323227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.323227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.323522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.323522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.323522] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 already deleted. [ 827.323622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.323720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.323879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.324437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.324437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.324437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.324437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.324719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.324719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.324719] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.326173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.326173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.326433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.326553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.326619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.326760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.326918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.326918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.327719] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.372944] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.373673] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.373932] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.374326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.374673] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.374865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.375057] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.375352] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.375940] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.375940] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.375940] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.376091] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.376203] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.376336] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.376450] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.376600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.401296] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.401296] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 827.402892] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.402892] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.402892] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.402892] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.402892] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.403265] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.403685] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.823454] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.823633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.823734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.823960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.824103] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.824287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.824320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.824674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.824674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.824787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.824897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.825026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.825105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.825258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.825408] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.825503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.825565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.825789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.825789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.825880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.825944] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.828981] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.830264] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.883267] env[65630]: INFO networking_nsxv3.common.synchronization [None req-15e05869-6a82-4906-b3ec-d07beae0dfb6 None None] Enqueued Resource ID: 6d5c1251-8fa6-48c1-9f1c-083cef0406a8 with Priority: HIGHEST for action port [ 827.885425] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d5c1251-8fa6-48c1-9f1c-083cef0406a8 with Priority: HIGHEST for action port [ 827.886026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d5c1251-8fa6-48c1-9f1c-083cef0406a8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.886026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d5c1251-8fa6-48c1-9f1c-083cef0406a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.886161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d5c1251-8fa6-48c1-9f1c-083cef0406a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.886347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d5c1251-8fa6-48c1-9f1c-083cef0406a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.886406] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d5c1251-8fa6-48c1-9f1c-083cef0406a8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.906811] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.907038] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.907192] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.907426] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.907578] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.907825] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 not found, creating... [ 827.909202] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.909439] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.909560] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.909823] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.910022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.910287] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.910491] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.910658] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.910906] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.911274] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.911525] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 is going to be created. [ 827.936588] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.937689] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.937689] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.937689] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.938419] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.940026] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.330018] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a73db6d-e930-47a9-9dbe-748ef759f251: rpc.has_security_group_logging(os_id): False [ 828.331259] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b25fb6e-f742-4dda-bb8b-ad33a402286e: rpc.has_security_group_logging(os_id): False [ 828.332892] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 129b80e0-f31c-48f3-b8cb-02ada0d90df9: rpc.has_security_group_logging(os_id): False [ 828.353886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.353886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.353886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.354136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.354182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.357844] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.357844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.357844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.358105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.358105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.358105] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e is going to be created. [ 828.363246] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.363394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.363467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.363722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.363836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.364083] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.364189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.364255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.364417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.364880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.365190] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.365323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.365393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.365552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.365636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.365863] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.365958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.366028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.366159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.366238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.366327] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 828.368704] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.368805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.368891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.369128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.369212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.369505] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.369624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.369689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.369843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.369921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.370050] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be updated. [ 828.393017] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d5c1251-8fa6-48c1-9f1c-083cef0406a8 [ 828.393017] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.393017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.393017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.393017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.393017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.393017] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d5c1251-8fa6-48c1-9f1c-083cef0406a8 already deleted. [ 828.393017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d5c1251-8fa6-48c1-9f1c-083cef0406a8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.449277] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.449277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.449277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.449277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.449721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.453477] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.453604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.453703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.455031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.455031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.466675] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.466836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.466922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.467169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.467376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.479191] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: IN_PROGRESS for 2s [ 828.493311] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: IN_PROGRESS for 2s [ 828.494059] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 828.516328] env[65630]: INFO networking_nsxv3.common.synchronization [None req-d13281d1-c156-4cec-a81e-ebac3eb5c3a0 None None] Enqueued Resource ID: b6aa5db0-6960-4326-841c-d4da336c0d3b with Priority: HIGHEST for action port [ 828.516586] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa5db0-6960-4326-841c-d4da336c0d3b with Priority: HIGHEST for action port [ 828.516890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6aa5db0-6960-4326-841c-d4da336c0d3b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.516998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6aa5db0-6960-4326-841c-d4da336c0d3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.517135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6aa5db0-6960-4326-841c-d4da336c0d3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.517340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6aa5db0-6960-4326-841c-d4da336c0d3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.517420] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6aa5db0-6960-4326-841c-d4da336c0d3b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.796027] env[65630]: INFO networking_nsxv3.common.synchronization [req-31b0aa05-33d7-4413-b48d-c7ce12865073 req-4d31e15e-1a2b-44d0-81e6-cf4da8e5852e service nova] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_rules [ 828.796027] env[65630]: INFO networking_nsxv3.common.synchronization [req-31b0aa05-33d7-4413-b48d-c7ce12865073 req-4d31e15e-1a2b-44d0-81e6-cf4da8e5852e service nova] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 828.796027] env[65630]: INFO networking_nsxv3.common.synchronization [req-31b0aa05-33d7-4413-b48d-c7ce12865073 req-4d31e15e-1a2b-44d0-81e6-cf4da8e5852e service nova] Enqueued Resource ID: 8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 with Priority: HIGHEST for action port [ 828.796027] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_rules [ 828.796667] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 828.796916] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 with Priority: HIGHEST for action port [ 828.797323] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.797790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.797969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.798355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.799561] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.803136] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.803136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.803136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.803136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.803136] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.803136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.803136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.803136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.803136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.803136] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.806172] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.806172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.806172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.806172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.806172] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.021721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6aa5db0-6960-4326-841c-d4da336c0d3b [ 829.022024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.022096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.022237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.023463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.023463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.023463] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6aa5db0-6960-4326-841c-d4da336c0d3b already deleted. [ 829.023463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6aa5db0-6960-4326-841c-d4da336c0d3b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.303574] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.303574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.305868] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.309419] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 with status ACTIVE [ 829.309655] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.309828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.309828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.310065] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.310211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.310555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.310555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.310555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.310771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.310771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.310865] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.311304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.311304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.311304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.311304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.311304] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8 is going to be updated. [ 829.334118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.334440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.334440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.336012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.336012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.336012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a07b0b7-bc4c-4ecf-9227-0e52905ca0e8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.809843] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.317156] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.317354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.317451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.317738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.317886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.317994] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be created. [ 830.344631] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.344942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.344942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.345072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.345245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.356405] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: UNINITIALIZED for 2s [ 830.493520] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 830.493645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.509171] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: SUCCESS [ 830.510412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.512971] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 830.513095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.676802] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a5c4212c-e000-48ef-bf64-4ad7f153e59f None None] Enqueued Resource ID: e656878c-34fa-425d-b7fd-1e168844723e with Priority: HIGHEST for action port [ 830.676802] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e656878c-34fa-425d-b7fd-1e168844723e with Priority: HIGHEST for action port [ 830.676802] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-e656878c-34fa-425d-b7fd-1e168844723e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.676802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e656878c-34fa-425d-b7fd-1e168844723e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.676802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e656878c-34fa-425d-b7fd-1e168844723e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.676802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e656878c-34fa-425d-b7fd-1e168844723e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.676802] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e656878c-34fa-425d-b7fd-1e168844723e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.917036] env[65630]: INFO networking_nsxv3.common.synchronization [req-b87b568e-69b1-4e58-9c2f-65dca6b127b4 req-50da5b7d-95d8-4747-9bee-828736d05c0a tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 830.917564] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 830.921773] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.922216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.922304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.922872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.923371] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.925025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.925098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.928016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.928016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.928016] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.179674] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e656878c-34fa-425d-b7fd-1e168844723e [ 831.179938] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.180108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.180169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.180396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.180504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.180587] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e656878c-34fa-425d-b7fd-1e168844723e already deleted. [ 831.180664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e656878c-34fa-425d-b7fd-1e168844723e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.433386] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.433683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.433683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.434022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.434022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.435734] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.435881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.435961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.438650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.438650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.438650] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 already deleted. [ 831.438650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.805560] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.806895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.806895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.806895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.806895] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.807442] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.807718] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.815840] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.815840] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.815840] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.815840] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.815840] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.815840] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.815840] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.815840] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.815840] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.836064] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.836064] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.836186] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.836643] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.836643] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-692936df-332f-49e5-b248-34e2501d955e taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.836827] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.836867] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.837216] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.837318] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692936df-332f-49e5-b248-34e2501d955e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.943017] env[65630]: INFO networking_nsxv3.common.synchronization [None req-c2dbd947-5ead-4699-a56b-65c15ab0fcab tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_rules [ 831.943248] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_rules [ 831.943441] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.943573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.943641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.943898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.943979] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.173973] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9daa74c2-9306-40b3-a4fc-0c166961f16f tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_rules [ 832.174553] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_rules [ 832.175135] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.175242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.346161] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.346161] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 692936df-332f-49e5-b248-34e2501d955e not found, creating... [ 832.346161] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.346161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.346863] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.346863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.346863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.347483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.347876] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.348868] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 692936df-332f-49e5-b248-34e2501d955e is going to be created. [ 832.366042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: SUCCESS [ 832.366337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.366739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.366979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.367197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.367369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.367369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.367535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.367621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.367706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.367798] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.372885] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.373101] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.373223] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.373468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.373684] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.373921] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.473636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.474014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.474014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.474120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.474248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.474349] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 already deleted. [ 832.474441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.474628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.474800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.474881] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.672422] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7e67a732-5dff-4947-b607-593174bdfd03 None None] Enqueued Resource ID: 88bbd64b-4a81-4419-ac34-2a0421d357f0 with Priority: HIGHEST for action port [ 832.672422] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bbd64b-4a81-4419-ac34-2a0421d357f0 with Priority: HIGHEST for action port [ 832.672422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-88bbd64b-4a81-4419-ac34-2a0421d357f0 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.672422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88bbd64b-4a81-4419-ac34-2a0421d357f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.672422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88bbd64b-4a81-4419-ac34-2a0421d357f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.672703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88bbd64b-4a81-4419-ac34-2a0421d357f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.672703] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88bbd64b-4a81-4419-ac34-2a0421d357f0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.870661] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.871134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.871134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.871134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.871306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.871306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.871389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.871539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.871629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.871724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.871876] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.871972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.872047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.872204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.872345] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.872434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.872517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.872671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.872750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.872833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.872919] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.000320] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.000456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.000525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.000796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.000866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.000916] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 already deleted. [ 833.000998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.129135] env[65630]: INFO networking_nsxv3.common.synchronization [req-b87b568e-69b1-4e58-9c2f-65dca6b127b4 req-b218a73a-c462-4623-b09d-b674db1a642d service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 833.129333] env[65630]: INFO networking_nsxv3.common.synchronization [req-b87b568e-69b1-4e58-9c2f-65dca6b127b4 req-b218a73a-c462-4623-b09d-b674db1a642d service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 833.129800] env[65630]: INFO networking_nsxv3.common.synchronization [req-b87b568e-69b1-4e58-9c2f-65dca6b127b4 req-b218a73a-c462-4623-b09d-b674db1a642d service nova] Enqueued Resource ID: 692936df-332f-49e5-b248-34e2501d955e with Priority: HIGHEST for action port [ 833.130009] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 833.130154] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 833.130424] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 692936df-332f-49e5-b248-34e2501d955e with Priority: HIGHEST for action port [ 833.130725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.130850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.130912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.131308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.131421] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.132306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.132419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.132544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.132710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.133033] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.133033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.133033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.133236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.133236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.133400] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.134827] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-692936df-332f-49e5-b248-34e2501d955e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.134827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.134827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.134827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.134827] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692936df-332f-49e5-b248-34e2501d955e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.175684] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88bbd64b-4a81-4419-ac34-2a0421d357f0 [ 833.175830] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.175987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.176111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.176625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.176625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.176625] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88bbd64b-4a81-4419-ac34-2a0421d357f0 already deleted. [ 833.176625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88bbd64b-4a81-4419-ac34-2a0421d357f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.376497] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00ac0e45-8fb0-4a0b-aeee-053765768653: rpc.has_security_group_logging(os_id): False [ 833.397605] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.397809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.397928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.398094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.398179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.398627] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.398851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.398933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.399147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.399231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.399459] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.399585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.399948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.400173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.400257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.400645] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.400773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.400839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.400991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.401119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.401217] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be created. [ 833.476592] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.476592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.476592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.477282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.477282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.490430] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: IN_PROGRESS for 2s [ 833.576226] env[65630]: INFO networking_nsxv3.common.synchronization [req-088ec025-8756-472e-a8da-dab6c7d1bdbb req-d8514088-d068-4048-ae91-f3c5d5883b33 tempest-ServersNegativeTestJSON-111815627 tempest-ServersNegativeTestJSON-111815627-project-member] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 833.576226] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 833.576226] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.576226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.576226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.576226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.576581] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.576635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.576776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.576918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.577024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.577120] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.635927] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.640607] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.640607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.640891] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 692936df-332f-49e5-b248-34e2501d955e with status ACTIVE [ 833.641166] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.641255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.641291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.641490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.641608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.641794] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.641891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.642246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.642506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.642588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.643586] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.643737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.643822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.644042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.644129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.644220] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 692936df-332f-49e5-b248-34e2501d955e is going to be updated. [ 833.667701] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.667879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.667919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.668149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.668285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.668445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-692936df-332f-49e5-b248-34e2501d955e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.080720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.080897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.080938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.081201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.081293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.081557] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.081920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.082046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.082298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.082422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.082565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd already deleted. [ 834.082688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.142380] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.273172] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.273373] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.273492] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.274027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.274027] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.274164] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.274277] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.274490] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.274630] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.274832] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.274939] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.275053] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.275157] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.275260] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.275357] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.275490] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.296014] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.296195] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.296430] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.296663] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.296852] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-ba559057-9d08-428b-835d-0b2b06025dfc taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.297035] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.297152] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.297504] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.297647] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba559057-9d08-428b-835d-0b2b06025dfc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.646227] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.646227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.646227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.646227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.646627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.646627] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be created. [ 834.679995] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.680278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.683257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.683546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.683680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.698672] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: UNINITIALIZED for 2s [ 834.800715] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.800715] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.800715] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.800898] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.801054] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.801343] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port ba559057-9d08-428b-835d-0b2b06025dfc not found, creating... [ 834.801496] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.801665] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.801803] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.802050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.802193] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.802992] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.802992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.802992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.804548] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.804789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.805117] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: ba559057-9d08-428b-835d-0b2b06025dfc is going to be created. [ 834.830011] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.830299] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.830425] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.833394] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.833394] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.833394] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.069380] env[65630]: INFO networking_nsxv3.common.synchronization [None req-6ecddd36-a0f1-4614-8046-5f5acbf392ee None None] Enqueued Resource ID: d1cd05c7-3cb5-463f-940a-f415b378b162 with Priority: HIGHEST for action port [ 835.069380] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1cd05c7-3cb5-463f-940a-f415b378b162 with Priority: HIGHEST for action port [ 835.069893] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1cd05c7-3cb5-463f-940a-f415b378b162 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.069996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1cd05c7-3cb5-463f-940a-f415b378b162" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.070093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1cd05c7-3cb5-463f-940a-f415b378b162" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.070571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1cd05c7-3cb5-463f-940a-f415b378b162" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.070658] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1cd05c7-3cb5-463f-940a-f415b378b162',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.502843] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: SUCCESS [ 835.503684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.572711] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1cd05c7-3cb5-463f-940a-f415b378b162 [ 835.573119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.573221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.573221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.573451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.573547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.573646] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1cd05c7-3cb5-463f-940a-f415b378b162 already deleted. [ 835.573730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1cd05c7-3cb5-463f-940a-f415b378b162" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.614584] env[65630]: INFO networking_nsxv3.common.synchronization [req-088ec025-8756-472e-a8da-dab6c7d1bdbb req-0041bd70-7351-4a4d-b854-a994c9f591a1 service nova] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_rules [ 835.614723] env[65630]: INFO networking_nsxv3.common.synchronization [req-088ec025-8756-472e-a8da-dab6c7d1bdbb req-0041bd70-7351-4a4d-b854-a994c9f591a1 service nova] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 835.614854] env[65630]: INFO networking_nsxv3.common.synchronization [req-088ec025-8756-472e-a8da-dab6c7d1bdbb req-0041bd70-7351-4a4d-b854-a994c9f591a1 service nova] Enqueued Resource ID: ba559057-9d08-428b-835d-0b2b06025dfc with Priority: HIGHEST for action port [ 835.615513] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_rules [ 835.615606] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 835.615698] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba559057-9d08-428b-835d-0b2b06025dfc with Priority: HIGHEST for action port [ 835.615981] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.616274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.616419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.617016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.617595] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.618769] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.618991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.618991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.619212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.619411] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.619522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.619598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.619816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.619923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.620050] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.621165] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba559057-9d08-428b-835d-0b2b06025dfc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.621244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.621635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.621763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.621845] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba559057-9d08-428b-835d-0b2b06025dfc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.124186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.124669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.124669] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.129550] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba559057-9d08-428b-835d-0b2b06025dfc with status ACTIVE [ 836.129550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.129550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.129550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.129550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.130747] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba559057-9d08-428b-835d-0b2b06025dfc is going to be updated. [ 836.152307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.152307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.152307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.152494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.152591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.152796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.628459] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.710170] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 836.711378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.712028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.712935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.715017] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.715017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.715017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.715017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.715017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.715017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.715017] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.844091] env[65630]: INFO networking_nsxv3.common.synchronization [None req-94afbcf2-066e-4d22-9063-706d85d8d9e6 None None] Enqueued Resource ID: 72241c4d-3417-45a5-82e7-ec03144e441e with Priority: HIGHEST for action port [ 836.844625] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72241c4d-3417-45a5-82e7-ec03144e441e with Priority: HIGHEST for action port [ 836.844953] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-72241c4d-3417-45a5-82e7-ec03144e441e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.845062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72241c4d-3417-45a5-82e7-ec03144e441e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.845121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72241c4d-3417-45a5-82e7-ec03144e441e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.845369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72241c4d-3417-45a5-82e7-ec03144e441e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.845450] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72241c4d-3417-45a5-82e7-ec03144e441e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.133601] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.133996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.133996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.134104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.134222] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.134288] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be created. [ 837.153177] env[65630]: INFO networking_nsxv3.common.synchronization [None req-f2cfd67d-550c-4a69-a948-1715d31620a3 None None] Enqueued Resource ID: 4658803a-33cd-4a8a-bac6-8216c10336b4 with Priority: HIGHEST for action port [ 837.153944] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4658803a-33cd-4a8a-bac6-8216c10336b4 with Priority: HIGHEST for action port [ 837.154309] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4658803a-33cd-4a8a-bac6-8216c10336b4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.154439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4658803a-33cd-4a8a-bac6-8216c10336b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.154518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4658803a-33cd-4a8a-bac6-8216c10336b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.154781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4658803a-33cd-4a8a-bac6-8216c10336b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.154880] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4658803a-33cd-4a8a-bac6-8216c10336b4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.162447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.163109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.163109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.163109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.163109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.175879] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: UNINITIALIZED for 2s [ 837.220618] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.220618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.220618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.220618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.220618] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.221119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.221119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.221119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.221119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.221242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.221994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.221994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.221994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.221994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.221994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.221994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.223299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.223299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.223299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.223299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.223299] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.350292] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72241c4d-3417-45a5-82e7-ec03144e441e [ 837.350292] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.350292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.350292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.350292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.350983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.350983] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72241c4d-3417-45a5-82e7-ec03144e441e already deleted. [ 837.350983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72241c4d-3417-45a5-82e7-ec03144e441e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.657431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4658803a-33cd-4a8a-bac6-8216c10336b4 [ 837.658872] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.658872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.658872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.658872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.658872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.658872] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4658803a-33cd-4a8a-bac6-8216c10336b4 already deleted. [ 837.658872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4658803a-33cd-4a8a-bac6-8216c10336b4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.726713] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14b62121-4e0b-44ce-9aab-8ed6b4024ea4: rpc.has_security_group_logging(os_id): False [ 837.749237] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.749411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.749493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.749849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.750032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.751962] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.751962] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.751962] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.751962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.752737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.752946] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be created. [ 837.815039] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.815039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.815039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.815039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.815039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.834134] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 839.189049] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 839.189354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.189498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.189703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.190555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.190555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.190555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.190555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.190555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.190555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.190966] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.699460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.699923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.699923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.700128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.700208] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.700304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.700386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.700555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.700634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.700734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.700896] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.701026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.701129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.701209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.701353] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.701458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.701525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.702869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.702869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.702869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.702869] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.853777] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 839.854235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.204404] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57e44ebf-431f-48ef-9d59-768d3bda2cbd: rpc.has_security_group_logging(os_id): False [ 840.229606] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.229606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.229606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.231559] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.231559] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.231559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.233852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.233852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.233852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.233852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.233852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.233852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.233852] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be created. [ 840.316606] env[65630]: INFO networking_nsxv3.common.synchronization [None req-14eecfe5-e338-4425-b4e5-6fb6a42ffe58 None None] Enqueued Resource ID: b2c68c25-8a09-4b22-93ff-b72338516476 with Priority: HIGHEST for action port [ 840.318021] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c68c25-8a09-4b22-93ff-b72338516476 with Priority: HIGHEST for action port [ 840.318426] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2c68c25-8a09-4b22-93ff-b72338516476 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.318664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2c68c25-8a09-4b22-93ff-b72338516476" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.318664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2c68c25-8a09-4b22-93ff-b72338516476" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.318968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2c68c25-8a09-4b22-93ff-b72338516476" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.319065] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c68c25-8a09-4b22-93ff-b72338516476',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.331908] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.331908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.331908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.331908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.332592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.348608] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 840.421325] env[65630]: INFO networking_nsxv3.common.synchronization [req-da4ac3ab-6432-45cc-adc8-c3da305b8bae req-08f138b8-3bab-432c-9b65-2c0a39b21b21 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 840.421979] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 840.422498] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.422946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.422946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.423104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.423165] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.423285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.423353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.423503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.423581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.423670] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.821637] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2c68c25-8a09-4b22-93ff-b72338516476 [ 840.821910] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.822186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.822186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.822405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.822509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.822889] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2c68c25-8a09-4b22-93ff-b72338516476 already deleted. [ 840.822889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2c68c25-8a09-4b22-93ff-b72338516476" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.869095] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.869095] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.869095] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.869095] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.869352] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.869417] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.869688] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.869834] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.870031] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.870324] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.870416] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.870519] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.870663] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.871121] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.871121] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.871121] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.891195] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.891370] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.891503] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.891706] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.892353] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.892353] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.892353] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.892925] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.892925] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f5263ee-0f19-4d86-8e60-e7e16c8c8315',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.925946] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.926123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.926234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.926387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.926517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.926664] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.926763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.926962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.926962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.927131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.927131] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 already deleted. [ 840.927329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.394699] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.395368] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.395368] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.395368] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.395550] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.395678] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 1f5263ee-0f19-4d86-8e60-e7e16c8c8315 not found, creating... [ 841.395979] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.396186] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.396322] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.396556] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.396707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.397031] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.397193] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.397305] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.397544] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.397732] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.397815] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 1f5263ee-0f19-4d86-8e60-e7e16c8c8315 is going to be created. [ 841.424701] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.424916] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.424916] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.426389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.426389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.426389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.319361] env[65630]: INFO networking_nsxv3.common.synchronization [req-da4ac3ab-6432-45cc-adc8-c3da305b8bae req-54f278e3-72b8-4c37-bcf8-97261b6fdb94 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 842.319361] env[65630]: INFO networking_nsxv3.common.synchronization [req-da4ac3ab-6432-45cc-adc8-c3da305b8bae req-54f278e3-72b8-4c37-bcf8-97261b6fdb94 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 842.319361] env[65630]: INFO networking_nsxv3.common.synchronization [req-da4ac3ab-6432-45cc-adc8-c3da305b8bae req-54f278e3-72b8-4c37-bcf8-97261b6fdb94 service nova] Enqueued Resource ID: 1f5263ee-0f19-4d86-8e60-e7e16c8c8315 with Priority: HIGHEST for action port [ 842.320976] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 842.320976] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 842.320976] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5263ee-0f19-4d86-8e60-e7e16c8c8315 with Priority: HIGHEST for action port [ 842.320976] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.320976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.320976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.321461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.321461] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.324016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.324016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.324016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.324016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.324016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.324016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.324016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.324016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.324016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.324016] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.324908] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.325064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.325129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.325265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.325339] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f5263ee-0f19-4d86-8e60-e7e16c8c8315',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.368936] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 842.368936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.827555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.827555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.827555] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.828936] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f5263ee-0f19-4d86-8e60-e7e16c8c8315 with status ACTIVE [ 842.828936] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.828936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.828936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.829218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.829218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.831611] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.831745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.831842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.832805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.832805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.832805] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.832805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.832805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.833107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.833107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.833172] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f5263ee-0f19-4d86-8e60-e7e16c8c8315 is going to be updated. [ 842.865528] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.865528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.865528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.865528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.865528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.865528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f5263ee-0f19-4d86-8e60-e7e16c8c8315" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.336045] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.839997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.840344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.840344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.840449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.840654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.840654] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be created. [ 843.891019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.891278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.891278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.892035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.892035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.904982] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: UNINITIALIZED for 2s [ 845.543616] env[65630]: INFO networking_nsxv3.common.synchronization [None req-ccb9922c-462d-4616-8209-16052df90578 None None] Enqueued Resource ID: 653222c7-7ff1-406f-b34e-8cbd8443fc37 with Priority: HIGHEST for action port [ 845.544652] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653222c7-7ff1-406f-b34e-8cbd8443fc37 with Priority: HIGHEST for action port [ 845.545544] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-653222c7-7ff1-406f-b34e-8cbd8443fc37 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.545809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-653222c7-7ff1-406f-b34e-8cbd8443fc37" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.545809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-653222c7-7ff1-406f-b34e-8cbd8443fc37" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.546162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-653222c7-7ff1-406f-b34e-8cbd8443fc37" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.546345] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('653222c7-7ff1-406f-b34e-8cbd8443fc37',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.685214] env[65630]: INFO networking_nsxv3.common.synchronization [None req-fa221951-7015-46c8-a91d-841425b209e1 None None] Enqueued Resource ID: 5d941aae-bbf4-4639-99e7-f256a3fd6981 with Priority: HIGHEST for action port [ 845.686100] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d941aae-bbf4-4639-99e7-f256a3fd6981 with Priority: HIGHEST for action port [ 845.686460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d941aae-bbf4-4639-99e7-f256a3fd6981 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.686605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d941aae-bbf4-4639-99e7-f256a3fd6981" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.686738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d941aae-bbf4-4639-99e7-f256a3fd6981" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.690024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d941aae-bbf4-4639-99e7-f256a3fd6981" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.690024] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d941aae-bbf4-4639-99e7-f256a3fd6981',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.918856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 845.919094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.919257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.919515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.919873] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.919873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.920345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.920457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.920540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.920632] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.048979] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 653222c7-7ff1-406f-b34e-8cbd8443fc37 [ 846.049154] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.049298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.049372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.049704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.049819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.049919] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:653222c7-7ff1-406f-b34e-8cbd8443fc37 already deleted. [ 846.050024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-653222c7-7ff1-406f-b34e-8cbd8443fc37" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.189595] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d941aae-bbf4-4639-99e7-f256a3fd6981 [ 846.190043] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.190212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.190351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.190655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.190795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.190954] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d941aae-bbf4-4639-99e7-f256a3fd6981 already deleted. [ 846.191092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d941aae-bbf4-4639-99e7-f256a3fd6981" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.424043] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.424043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.424241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.424535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.425274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.425480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.425593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.425889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.426032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.426187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.426447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.426595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.426687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.426945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.427395] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.427562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.427682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.427939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.428109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.428252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.428373] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.934947] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71bd905-a59a-420e-96dc-4f48e2b11e86: rpc.has_security_group_logging(os_id): False [ 846.956716] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.956853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.956924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.957428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.957428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.957733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.957733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.957733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.957934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.957934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.958193] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.958193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.958430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.958430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.958603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.958681] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.958853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.958853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.958995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.959101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.959221] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be created. [ 847.036092] env[65630]: INFO networking_nsxv3.common.synchronization [req-6176924e-8fe3-4ec5-8c54-81c29478f2c8 req-532c2c71-2a35-4b30-85a5-0de4add33060 tempest-DeleteServersAdminTestJSON-597315484 tempest-DeleteServersAdminTestJSON-597315484-project-admin] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 847.036759] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 847.037090] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.037243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.037318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.037510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.037665] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.037765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.037824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.037979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.038109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.038207] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.043831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.044239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.044483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.045211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.045631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.060362] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 847.540757] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.541111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.541184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.541523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.541855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.541992] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.542153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.542285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.542564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.542695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.542850] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be updated. [ 847.577402] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.577551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.577617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.577837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.577975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.594713] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: IN_PROGRESS for 2s [ 848.303981] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.304303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.304303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.304906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.305288] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.808152] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.891446] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5faedbe6-7382-4115-8a4a-666bb0eb62f3 None None] Enqueued Resource ID: 0888ea53-b1b9-42cc-b22a-c2ab94a92b8b with Priority: HIGHEST for action port [ 848.892458] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0888ea53-b1b9-42cc-b22a-c2ab94a92b8b with Priority: HIGHEST for action port [ 848.893299] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0888ea53-b1b9-42cc-b22a-c2ab94a92b8b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.893759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0888ea53-b1b9-42cc-b22a-c2ab94a92b8b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.893986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0888ea53-b1b9-42cc-b22a-c2ab94a92b8b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.895189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0888ea53-b1b9-42cc-b22a-c2ab94a92b8b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.895189] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0888ea53-b1b9-42cc-b22a-c2ab94a92b8b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.076136] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 849.076420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.312206] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.399042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0888ea53-b1b9-42cc-b22a-c2ab94a92b8b [ 849.399042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.399042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.399042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.399042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.399042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.399042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0888ea53-b1b9-42cc-b22a-c2ab94a92b8b already deleted. [ 849.399042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0888ea53-b1b9-42cc-b22a-c2ab94a92b8b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.610237] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: SUCCESS [ 849.610237] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 deletion is rescheduled due to dependency. [ 849.610237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.663158] env[65630]: INFO networking_nsxv3.common.synchronization [req-b39ebbea-07d7-4f8b-9253-5bf6ada8cc42 req-d6564410-eff3-4a68-83c8-805bffda75c6 tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 849.664675] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 849.665069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.665069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.665283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.665326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.666784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.666784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.666784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.666784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.666784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.666784] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.814778] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 849.814989] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 850.169201] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.238277] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4399562-ffb8-433a-9f8d-a7d2736e46c2 req-3aedeb07-c6f3-4de4-b0c6-eb6941b85a57 tempest-ServerPasswordTestJSON-90451307 tempest-ServerPasswordTestJSON-90451307-project-member] Enqueued Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_members [ 850.239252] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_members [ 850.241437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.242166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.242475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.243179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.243582] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.243919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.244234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.245048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.245330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.245622] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.672429] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.887141] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.887141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.887141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.887141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.887141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.887141] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.887141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.887141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.887141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.887721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.887721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 already deleted. [ 850.887721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.890527] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.890527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.890527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.890527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.890527] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.890527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.890527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.890527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.891141] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.891141] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.891141] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.891141] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.891369] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.891369] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.891369] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.892881] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.926183] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.926361] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.926676] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.926676] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.926992] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.927414] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.927414] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.927720] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.927883] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1760ea40-97fa-48cd-b6e1-8ca18d30cc2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.117509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.117509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.117839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.117986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.136695] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 851.137737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.139084] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 851.174963] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.175142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.175226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.175602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.182542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.183099] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 851.183264] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 851.183319] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 851.184614] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.184765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.184850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.185114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.185218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.185310] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 851.220890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.221299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.221299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.221489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.221740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.233815] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 851.244174] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.244440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.244513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.244773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.246400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.246660] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 851.394673] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.394871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.395127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.395403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.395858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.396192] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 851.431675] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.431983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.432697] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.433018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.434487] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.434487] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 1760ea40-97fa-48cd-b6e1-8ca18d30cc2d not found, creating... [ 851.434487] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.434487] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.435011] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.435011] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.435692] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.436225] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.436472] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.436666] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.437015] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.437208] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.439019] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 1760ea40-97fa-48cd-b6e1-8ca18d30cc2d is going to be created. [ 851.480574] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.480915] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.481150] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.481565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.484522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.485164] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.527410] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.527410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.527410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.527410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.527897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.527897] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 851.527968] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6', '4db90ff6-65fb-428b-b489-30d9d407642e', 'f55a976b-1ec3-494a-b8f8-938b05f19fbd', '397b25ae-6929-46ce-8711-37502e4943b3', 'e3541bfc-04c2-4eba-9579-7dda3fc0388c', '59e543f5-3a08-4982-8918-ea2593f725ef', '0aff3db7-d7a7-4b84-8908-260cd4cfa00e', '129b80e0-f31c-48f3-b8cb-02ada0d90df9', '63a2bd5a-73f9-4706-b4d6-3b2079addc81', '64208df3-7a31-4f66-a25a-21b69af6c4be', 'e6e4b9ba-b619-44fb-9494-9deb59f438b6', '3cd1c6ab-c111-4ed9-adb8-faa330316c36', '52f85ab7-23ea-4874-b442-58c60cf9adee', '9d21511b-a9da-4941-a727-0448d9306e2b', 'bc737fb1-ae72-4521-a2d8-98c1cf06601a', '9b518e97-7b02-47cd-a0e2-8f4af219c7ff', '4fceb03c-a6a6-44ca-a458-09915f16c26b', 'f3ab3235-b9b7-40f8-b1e6-960342fce805', '05b37c50-233f-4cfb-bd1b-645d04b17ca5', 'effa588b-c067-4072-96e1-1b9dab231ed7', '283b63f2-dcb7-43d1-8f8b-ceaa21132d6d', '55cab18d-dd48-49fe-b38f-0e7e827f237c', '5a73db6d-e930-47a9-9dbe-748ef759f251', 'f2ce74e6-0ec2-49a0-a447-71132c9e529b', '6a30c8a0-56ed-49c0-9575-ac779408f52f', '0e647f36-5543-4052-8cd2-b972c5bc69c3', '00ac0e45-8fb0-4a0b-aeee-053765768653', 'b71bd905-a59a-420e-96dc-4f48e2b11e86', '250f01a9-6e9d-4438-a22e-10b77875cd34', 'a5d959e5-8b2a-40d2-918d-da1d80daa362', 'dcabb3c1-63c7-4e6e-99e0-7cb17896f367', 'b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d', 'e8db9dba-41a6-4390-8a03-e9d1a073b831', '313d0c55-f8bb-4559-9f42-dfae7678f0bc', '29cd0e69-d83a-4e99-940e-3b95d8bf9b2d', 'd4010c2f-2754-4e2d-949f-ec21a2348a3d', '14b62121-4e0b-44ce-9aab-8ed6b4024ea4', '57e44ebf-431f-48ef-9d59-768d3bda2cbd', '0b25fb6e-f742-4dda-bb8b-ad33a402286e', 'f3c09c32-a206-4c5b-9a2a-99cacfd18ac7', 'bee721e8-67ba-4959-8884-95efeb9d52b8', '6f9d43bc-6007-4e6a-81c6-321db263b170'} {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 851.528065] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 851.568831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.569185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.569295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.569715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.569829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.569916] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 851.570017] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 851.570116] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 851.700479] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.700840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.700840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.701135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.704431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.704431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 851.704431] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 851.704431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 851.704431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 851.704431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGH for action security_group_rules [ 851.704431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.178495] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4399562-ffb8-433a-9f8d-a7d2736e46c2 req-9162cf64-c233-4196-a42d-ece6a2cadfa3 service nova] Enqueued Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_rules [ 852.178638] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4399562-ffb8-433a-9f8d-a7d2736e46c2 req-9162cf64-c233-4196-a42d-ece6a2cadfa3 service nova] Enqueued Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_members [ 852.178784] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4399562-ffb8-433a-9f8d-a7d2736e46c2 req-9162cf64-c233-4196-a42d-ece6a2cadfa3 service nova] Enqueued Resource ID: 1760ea40-97fa-48cd-b6e1-8ca18d30cc2d with Priority: HIGHEST for action port [ 852.179810] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_rules [ 852.179978] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_members [ 852.180138] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1760ea40-97fa-48cd-b6e1-8ca18d30cc2d with Priority: HIGHEST for action port [ 852.180311] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGH for action security_group_rules [ 852.180456] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd with Priority: HIGH for action security_group_rules [ 852.180613] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGH for action security_group_rules [ 852.180780] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a with Priority: HIGH for action security_group_rules [ 852.181154] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effa588b-c067-4072-96e1-1b9dab231ed7 with Priority: HIGH for action security_group_rules [ 852.181349] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 with Priority: HIGH for action security_group_rules [ 852.181594] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 with Priority: HIGH for action security_group_rules [ 852.181958] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b with Priority: HIGH for action security_group_rules [ 852.182083] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d21511b-a9da-4941-a727-0448d9306e2b with Priority: HIGH for action security_group_rules [ 852.182219] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff with Priority: HIGH for action security_group_rules [ 852.182267] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f85ab7-23ea-4874-b442-58c60cf9adee with Priority: HIGH for action security_group_rules [ 852.182383] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 with Priority: HIGH for action security_group_rules [ 852.182450] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 with Priority: HIGH for action security_group_rules [ 852.182525] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64208df3-7a31-4f66-a25a-21b69af6c4be with Priority: HIGH for action security_group_rules [ 852.182616] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 with Priority: HIGH for action security_group_rules [ 852.182707] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGH for action security_group_rules [ 852.182793] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGH for action security_group_rules [ 852.182885] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGH for action security_group_rules [ 852.182965] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db90ff6-65fb-428b-b489-30d9d407642e with Priority: HIGH for action security_group_rules [ 852.183070] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGH for action security_group_rules [ 852.187373] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.187560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.187560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.187847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.187943] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.188994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.189145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.189204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.189387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.189554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.189676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.189750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.189868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.189955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.191779] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.194365] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.194511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.194580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.194811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.194907] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1760ea40-97fa-48cd-b6e1-8ca18d30cc2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.196393] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.196786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.196786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.196968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.196968] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.198328] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.198459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.198525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.198835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.198917] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a976b-1ec3-494a-b8f8-938b05f19fbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.201050] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.201050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.201050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.201050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.201050] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.204054] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.204204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.204264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.204465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.204535] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc737fb1-ae72-4521-a2d8-98c1cf06601a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.205712] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-effa588b-c067-4072-96e1-1b9dab231ed7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.205844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.205886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.206080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.206153] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('effa588b-c067-4072-96e1-1b9dab231ed7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.207831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.207831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.207831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.208081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.208081] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b37c50-233f-4cfb-bd1b-645d04b17ca5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.210565] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ab3235-b9b7-40f8-b1e6-960342fce805 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.210678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.210751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.210930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.211025] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ab3235-b9b7-40f8-b1e6-960342fce805',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.212484] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fceb03c-a6a6-44ca-a458-09915f16c26b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.212654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.212804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.212933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.212933] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fceb03c-a6a6-44ca-a458-09915f16c26b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.213218] env[65630]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 852.214065] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d21511b-a9da-4941-a727-0448d9306e2b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.214172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.214262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.214404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.214474] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d21511b-a9da-4941-a727-0448d9306e2b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.216590] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.216732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.216732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.216909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.217025] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b518e97-7b02-47cd-a0e2-8f4af219c7ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.217972] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f85ab7-23ea-4874-b442-58c60cf9adee taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.218112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.218161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.218323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.218399] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f85ab7-23ea-4874-b442-58c60cf9adee',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.220125] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.220125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.220304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.220384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.220453] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cd1c6ab-c111-4ed9-adb8-faa330316c36',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.221882] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.222151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.222224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.222379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.222453] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6e4b9ba-b619-44fb-9494-9deb59f438b6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.223411] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64208df3-7a31-4f66-a25a-21b69af6c4be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.223574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.223659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.223771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.223849] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64208df3-7a31-4f66-a25a-21b69af6c4be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.225437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.225560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.225623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.225778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.225853] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a2bd5a-73f9-4706-b4d6-3b2079addc81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.226782] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.227018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.227154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.227253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.227366] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.228215] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.228323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.228388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.228871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.228871] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.230220] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.230444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.230444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.230566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.230639] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.231040] env[65630]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 852.231887] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4db90ff6-65fb-428b-b489-30d9d407642e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.232231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.232297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.232460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.232537] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4db90ff6-65fb-428b-b489-30d9d407642e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.236880] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.236880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.236880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.236880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.236880] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.695226] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.697237] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1760ea40-97fa-48cd-b6e1-8ca18d30cc2d with status ACTIVE [ 852.697237] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.697237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.697473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.697506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.697591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.698750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.698750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.698750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.699213] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1760ea40-97fa-48cd-b6e1-8ca18d30cc2d is going to be updated. [ 852.729760] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.729760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.729760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.729760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.729760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.729760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1760ea40-97fa-48cd-b6e1-8ca18d30cc2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.736925] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.737538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.737538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.738784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.738784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.738784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.738784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.738784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.738784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.738784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.738784] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.743733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.743882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.743973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.744994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.749215] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.749215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.751159] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.751159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.784521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.784521] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be deleted. [ 852.785874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.785987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.792550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.792767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.796715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.797099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.797099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.797382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.797382] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.797585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.797585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.797809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.797809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.797971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.797971] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.805084] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.805084] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.805084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.805084] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.812167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.812167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.812167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.812403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.813477] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.813477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.813477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.813477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.813477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.813477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.813477] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.818673] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.818673] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.818673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.818673] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.833817] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.842379] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.842536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.889289] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.889424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.900826] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.900915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.902095] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.902227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.904169] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.904169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.904169] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.904169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.905116] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.905224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.906045] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.906562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.907493] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.907607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.913187] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.913187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.913187] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 852.913432] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.913432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.914749] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 852.915320] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.915487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.919301] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 852.919301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.919301] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a976b-1ec3-494a-b8f8-938b05f19fbd is going to be deleted. [ 852.919301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.919301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.938585] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.938672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.946373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.947135] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc737fb1-ae72-4521-a2d8-98c1cf06601a is going to be deleted. [ 852.949354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.949354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.986215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.986402] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a2bd5a-73f9-4706-b4d6-3b2079addc81 is going to be deleted. [ 852.987494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.987764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.023623] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.023910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.036414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.036601] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fceb03c-a6a6-44ca-a458-09915f16c26b is going to be deleted. [ 853.037891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.038675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.041805] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.041972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.098645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.098788] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: effa588b-c067-4072-96e1-1b9dab231ed7 is going to be deleted. [ 853.102056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.102056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.147742] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.147877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.149980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.150198] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d21511b-a9da-4941-a727-0448d9306e2b is going to be deleted. [ 853.151160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.151411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.195660] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.195848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.197331] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.221323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.221323] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64208df3-7a31-4f66-a25a-21b69af6c4be is going to be deleted. [ 853.221323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.221323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.222795] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.223181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.252540] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.252540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.252540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.252540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.252772] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.252772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.252882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.253142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.255888] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.255888] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.255888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.255888] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.259103] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 853.259419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.279008] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.279182] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ab3235-b9b7-40f8-b1e6-960342fce805 is going to be deleted. [ 853.280519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.280771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.319311] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.319467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.323542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.323707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.323782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.324174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.324366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.324478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.324542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.324746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.324841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.324977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.325099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.325656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.325656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.325656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.325656] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.325656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.325875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.325875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.326029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.326258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.326258] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.327311] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.329240] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.340529] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3541bfc-04c2-4eba-9579-7dda3fc0388c: rpc.has_security_group_logging(os_id): False [ 853.354892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.354892] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b518e97-7b02-47cd-a0e2-8f4af219c7ff is going to be deleted. [ 853.355584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.355833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.421406] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.421744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.449886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.449886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.460663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.461016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6e4b9ba-b619-44fb-9494-9deb59f438b6 is going to be deleted. [ 853.462771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.463652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.531879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.532060] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cd1c6ab-c111-4ed9-adb8-faa330316c36 is going to be deleted. [ 853.533165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.533404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.564715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.564715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.600764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.600764] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b37c50-233f-4cfb-bd1b-645d04b17ca5 is going to be deleted. [ 853.602546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.602870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.605097] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.605097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.661137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.661250] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4db90ff6-65fb-428b-b489-30d9d407642e is going to be deleted. [ 853.662394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.662599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.699866] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.700195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.700195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.700391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.700520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.700584] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 is going to be created. [ 853.729117] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.729117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.762666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6: rpc.has_security_group_logging(os_id): False [ 853.813029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.813029] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f85ab7-23ea-4874-b442-58c60cf9adee is going to be deleted. [ 853.813944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.814261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.814390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.814549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.814656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.814918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.814918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.815070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a976b-1ec3-494a-b8f8-938b05f19fbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.815629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.815823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.815902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.816306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc737fb1-ae72-4521-a2d8-98c1cf06601a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.816306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.816417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.816451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.816635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a2bd5a-73f9-4706-b4d6-3b2079addc81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.816684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.816885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.816941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.817054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fceb03c-a6a6-44ca-a458-09915f16c26b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.817198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.817353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.817470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.817553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-effa588b-c067-4072-96e1-1b9dab231ed7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.817686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.817847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.817923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.818055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d21511b-a9da-4941-a727-0448d9306e2b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.818208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.818356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.828058] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.828215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.829782] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59e543f5-3a08-4982-8918-ea2593f725ef: rpc.has_security_group_logging(os_id): False [ 853.831448] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397b25ae-6929-46ce-8711-37502e4943b3: rpc.has_security_group_logging(os_id): False [ 853.832128] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 129b80e0-f31c-48f3-b8cb-02ada0d90df9: rpc.has_security_group_logging(os_id): False [ 853.837174] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.837373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.858461] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.858726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.945362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.945788] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.945788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.945788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.945979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.945979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.946060] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c is going to be updated. [ 853.948051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.948253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.948253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.948520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.948670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.950595] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.950783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.950783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.950932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.952776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.952914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.953660] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.953768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.045776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.045776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.072481] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 in Status: UNINITIALIZED for 2s [ 854.138260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.138260] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.138260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.138260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.138260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.138260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.138260] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be updated. [ 854.141357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.141905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.142239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.142502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b518e97-7b02-47cd-a0e2-8f4af219c7ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.142765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.143067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.143295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.143546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6e4b9ba-b619-44fb-9494-9deb59f438b6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.143846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.144158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.144375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.149022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b37c50-233f-4cfb-bd1b-645d04b17ca5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.149022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.149022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.189662] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4bcbdd1-10f9-4b1c-9e6a-91aad7b8bd1c req-bd23429e-fdee-488b-9819-a290de6d6851 tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 854.190679] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.190843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.192516] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 854.193137] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.193295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.193366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.193610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.193808] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.193914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.194029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.194198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.194287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.194384] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.242485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.242846] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.242982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.243063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.243293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.243379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.243584] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.243680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.243736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.243906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.244086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.244569] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.244692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.244755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.244909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.244983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.245123] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be updated. [ 854.246738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.246964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.247064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.247186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64208df3-7a31-4f66-a25a-21b69af6c4be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.247668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.247818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.247904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.248033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ab3235-b9b7-40f8-b1e6-960342fce805" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.248209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.248427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.287305] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.287473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.363870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.363870] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.363870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.363870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.363870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.363870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.363870] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 854.364985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.365336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.365431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.365550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4db90ff6-65fb-428b-b489-30d9d407642e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cd1c6ab-c111-4ed9-adb8-faa330316c36" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f85ab7-23ea-4874-b442-58c60cf9adee" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.367057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.493854] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.494133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.501930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.502328] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.502502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.502610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.502950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.503096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.503456] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.503583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.503667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.503909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.504044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.504336] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.504448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.504534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.504733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.504842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.504972] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be updated. [ 854.506520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.506751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.506962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.508286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.508497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.508666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.569621] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.570150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.570235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.570478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.570644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.592683] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: IN_PROGRESS for 2s [ 854.598070] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: IN_PROGRESS for 2s [ 854.614272] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: IN_PROGRESS for 2s [ 854.656417] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.656417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.656417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.656417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.656417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.684749] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 854.688099] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.688320] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.688444] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.688720] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.688994] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.689945] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.690112] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.690379] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.690529] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.690754] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.690871] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.690994] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.691138] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.691251] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.691354] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.691492] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.696934] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.697141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.697190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.697381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.697482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.699169] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.699169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.699169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.699169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.699169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.699169] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be deleted. [ 854.736094] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.736368] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.736531] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.736767] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.737183] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.737524] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.737653] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.738019] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.738206] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f46a3d1-9bf9-4593-accf-7dc2c748f1cf',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.790850] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.791265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.791265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.791352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.791413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.791512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.801037] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 854.801037] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.801037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.801037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.801037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.801037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.856959] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 855.241746] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.242078] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.242282] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.242552] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.242749] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.243231] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 1f46a3d1-9bf9-4593-accf-7dc2c748f1cf not found, creating... [ 855.243415] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.243415] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.243543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.243790] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.243887] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.244200] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.244349] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.244465] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.244683] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.244799] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.244937] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 1f46a3d1-9bf9-4593-accf-7dc2c748f1cf is going to be created. [ 855.268026] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.268263] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.268263] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.268529] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.268747] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.268969] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.013197] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4bcbdd1-10f9-4b1c-9e6a-91aad7b8bd1c req-96c826e8-982b-4064-beff-cb2f6666978d service nova] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_rules [ 856.013476] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4bcbdd1-10f9-4b1c-9e6a-91aad7b8bd1c req-96c826e8-982b-4064-beff-cb2f6666978d service nova] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 856.013597] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4bcbdd1-10f9-4b1c-9e6a-91aad7b8bd1c req-96c826e8-982b-4064-beff-cb2f6666978d service nova] Enqueued Resource ID: 1f46a3d1-9bf9-4593-accf-7dc2c748f1cf with Priority: HIGHEST for action port [ 856.015238] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_rules [ 856.015238] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 856.015238] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f46a3d1-9bf9-4593-accf-7dc2c748f1cf with Priority: HIGHEST for action port [ 856.015238] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.016191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.016347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.016504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.016587] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.018335] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.018435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.018491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.018683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.019067] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.019067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.019377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.019561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.019721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.019765] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.021822] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.021957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.021957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.023489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.023489] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f46a3d1-9bf9-4593-accf-7dc2c748f1cf',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.083224] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 in Status: SUCCESS [ 856.083224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.083439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.083662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.083848] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.083960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.084036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.084209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.084299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.084592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.084592] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.524458] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.525674] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.525848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.527948] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f46a3d1-9bf9-4593-accf-7dc2c748f1cf with status ACTIVE [ 856.527948] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.527948] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.527948] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.527948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.529154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.529370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.530134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.530295] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f46a3d1-9bf9-4593-accf-7dc2c748f1cf is going to be updated. [ 856.556012] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.556178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.556248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.556461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.556600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.556773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f46a3d1-9bf9-4593-accf-7dc2c748f1cf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.587080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.587246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.587318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.587548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.587711] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.587811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.587870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.588059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.588149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.588242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.588402] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.588480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.588533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.588697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.588810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.588897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.588952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.589107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.589182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.589261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.589348] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.611572] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: SUCCESS [ 856.611572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.619776] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 856.621113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.633622] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 856.633622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.703983] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 856.704249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.712459] env[65630]: INFO networking_nsxv3.common.synchronization [req-d30fb1a0-53b5-48df-8ce6-401e893f1da8 req-40824e74-141f-494e-b494-53e914b7b251 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 856.713077] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 856.713399] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.713861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.714046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.714649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.714649] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.714649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.714976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.714976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.715878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.715878] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.966035] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 856.967115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.033759] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.095881] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3: rpc.has_security_group_logging(os_id): False [ 857.115169] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.115439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.115439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.115644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.115730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.116095] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.116202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.116655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.116655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.116655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.116941] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.116941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.116941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.117077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.118037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.118037] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.118037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.118037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.118037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.118037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.118037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 is going to be created. [ 857.202306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.202306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.202306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.202306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.202306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.215243] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 in Status: IN_PROGRESS for 2s [ 857.219108] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.219253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.219327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.223318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.245333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.245544] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.245703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.245745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.245932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.246030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.246140] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 857.282746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.282948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.283128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.283313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.283492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.293387] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 857.538789] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.539050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.539138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.539377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.539471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.539574] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be created. [ 857.571033] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.571604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.571604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.572892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.572892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.588177] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: UNINITIALIZED for 2s [ 859.230744] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 in Status: SUCCESS [ 859.231120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.305279] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 859.305462] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 859.305828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.600323] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 859.601467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.601467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.601467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.601467] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.601467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.602253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.602253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.602253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.602253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.602253] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.104561] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.106162] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.106162] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.106162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.106694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.106694] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.106694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.106694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.108035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.108035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.108035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.110617] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.613377] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0aff3db7-d7a7-4b84-8908-260cd4cfa00e: rpc.has_security_group_logging(os_id): False [ 860.636885] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.638071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.638071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.638071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.638071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.638071] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.638071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.638071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.638071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.638523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.638523] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.638523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.638523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.638667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.638667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.638849] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.638938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.638985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.642494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.642643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.642691] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be created. [ 860.724555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.725137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.725137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.725137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.725313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.739350] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 861.714888] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 861.715215] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 862.280291] env[65630]: INFO networking_nsxv3.common.synchronization [req-5da90c2b-78ba-4169-97b0-a89f34c4bbf1 req-d892c782-3412-49a2-8215-f7449123c40b tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 862.281110] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 862.281967] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.283561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.283561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.283561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.283561] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.283561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.283561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.284168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.284413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.284657] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.758945] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 862.759337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.773792] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.774078] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.774166] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.774463] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.774734] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.774890] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.775012] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.776773] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.777532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.777797] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.777920] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.778129] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.778215] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.778292] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.778395] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.778531] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.787740] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.787954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.788078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.792032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.792032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.792032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.792032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.792032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.792032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.792032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.792032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 already deleted. [ 862.792032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.800070] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.800316] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.800488] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.800744] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.801207] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-d786454e-d9cf-43a5-9a63-c3105e6ae621 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.801436] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.801569] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.801991] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.802625] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d786454e-d9cf-43a5-9a63-c3105e6ae621',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.305466] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.306071] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.306331] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.307136] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.307402] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.307648] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port d786454e-d9cf-43a5-9a63-c3105e6ae621 not found, creating... [ 863.308337] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.308337] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.308548] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.308963] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.309223] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.309718] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.309980] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.310228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.310600] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.310836] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.311133] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 is going to be created. [ 863.333505] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.333777] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.333855] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.334117] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.334411] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.334569] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.991271] env[65630]: INFO networking_nsxv3.common.synchronization [req-b6480547-9fcb-412b-86d2-bbb1a20a1f56 req-ab855ccb-4d7b-4970-aa60-c5c8d9a47b66 tempest-ListServerFiltersTestJSON-678265133 tempest-ListServerFiltersTestJSON-678265133-project-member] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 863.991925] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 863.992305] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.992474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.992564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.992843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.993057] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.993213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.993301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.993497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.993585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.993725] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.089441] env[65630]: INFO networking_nsxv3.common.synchronization [req-5da90c2b-78ba-4169-97b0-a89f34c4bbf1 req-55e162a8-4dd9-4e38-9f6d-aceea403b218 service nova] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 864.089633] env[65630]: INFO networking_nsxv3.common.synchronization [req-5da90c2b-78ba-4169-97b0-a89f34c4bbf1 req-55e162a8-4dd9-4e38-9f6d-aceea403b218 service nova] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 864.089823] env[65630]: INFO networking_nsxv3.common.synchronization [req-5da90c2b-78ba-4169-97b0-a89f34c4bbf1 req-55e162a8-4dd9-4e38-9f6d-aceea403b218 service nova] Enqueued Resource ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 with Priority: HIGHEST for action port [ 864.090412] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 864.090524] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 864.090620] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 with Priority: HIGHEST for action port [ 864.090904] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.094106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.094236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.094496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.094595] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.095525] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.095645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.095703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.095878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.096224] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.096331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.096429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.096590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.096689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.096794] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.097943] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d786454e-d9cf-43a5-9a63-c3105e6ae621 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.098081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.098146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.098304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.098403] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d786454e-d9cf-43a5-9a63-c3105e6ae621',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.498074] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.600746] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.602164] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d786454e-d9cf-43a5-9a63-c3105e6ae621 with status ACTIVE [ 864.602525] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.602785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.602922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.603192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.603353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.603758] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.603890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.603960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.604407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.604589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.604926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.605143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.605255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.605527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.605649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.605759] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 is going to be updated. [ 864.607988] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.608260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.634384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.634576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.634660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.634904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.635294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.635572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.877220] env[65630]: INFO networking_nsxv3.common.synchronization [req-02203106-27d4-4112-87e1-1093c4f24a15 req-7a6a9a40-6f73-4818-bd51-86c35b4b5a74 tempest-ServersTestBootFromVolume-671027587 tempest-ServersTestBootFromVolume-671027587-project-member] Enqueued Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_members [ 864.877220] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d with Priority: HIGHEST for action security_group_members [ 864.877220] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.877220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.877220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.877220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.877725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.877831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.877893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.878095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.878259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.878328] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29cd0e69-d83a-4e99-940e-3b95d8bf9b2d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.000328] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.108272] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.380643] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.380900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.381033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.381382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.411207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.411207] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.411207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.411456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.411589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.411779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.411870] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d is going to be updated. [ 865.453494] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.453996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.454267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.456752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.457098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.481375] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d in Status: IN_PROGRESS for 2s [ 865.507487] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.507487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.507487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.507487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.507487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.507487] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 865.565593] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.565593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.565593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.565886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.566106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.583082] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 865.613990] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.614220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.614302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.614582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.614674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.614827] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 is going to be created. [ 865.646034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.646034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.646034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.646508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.646653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.662519] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: UNINITIALIZED for 2s [ 866.100192] env[65630]: INFO networking_nsxv3.common.synchronization [req-9cc1cf82-dc49-4efc-a48b-faee439ded94 req-bdd20c02-fba5-4618-b369-2a13084bc017 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 866.100886] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 866.101258] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.101413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.101532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.102123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.102246] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.102350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.102414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.102581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.102667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.102877] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.105603] env[65630]: INFO networking_nsxv3.common.synchronization [req-d0941db3-49ff-4ca8-8098-1bf77f7676d6 req-3e9c559c-c18d-481f-95f7-4c8e98abad6e tempest-ServerRescueTestJSON-196804760 tempest-ServerRescueTestJSON-196804760-project-member] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 866.107516] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 866.107516] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.107516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.107516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.107516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.107516] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.107516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.107516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.107516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.108186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.108186] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.535286] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-276 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.535522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.535638] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.537320] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.537706] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.537893] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.538074] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.538389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.538532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.538758] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.538847] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.538957] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.539078] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.539189] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.539293] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.539429] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.563104] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.565153] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.565153] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.565153] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.565153] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-2084685b-be19-4bda-b631-e24e2cdbbab2 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.565153] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.565153] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.565153] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.565667] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2084685b-be19-4bda-b631-e24e2cdbbab2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.606804] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.607234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.607234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.608090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.609646] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.609763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.632540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.632648] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.632766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.632855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.633644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.633644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.633644] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 866.635051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.635051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.635051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.635051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.635051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.635051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.635363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.635498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.635622] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 already deleted. [ 866.635743] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.674809] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.674809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.674809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.674992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.676487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.686661] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 867.068882] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.069594] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.070050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.072025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.072025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.072025] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 2084685b-be19-4bda-b631-e24e2cdbbab2 not found, creating... [ 867.073100] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.073100] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.073100] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.073100] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.073549] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.074204] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.074663] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.075035] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.075535] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.076109] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.076234] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 2084685b-be19-4bda-b631-e24e2cdbbab2 is going to be created. [ 867.101999] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.101999] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.101999] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.102613] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.102966] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.103336] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.225018] env[65630]: INFO networking_nsxv3.common.synchronization [req-a67ffd8e-2a17-4ac1-9176-ef96f909503d req-b017fe67-4f5c-4be6-8b0c-8e9d42745a7f tempest-ServerPasswordTestJSON-90451307 tempest-ServerPasswordTestJSON-90451307-project-member] Enqueued Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_members [ 867.225018] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGHEST for action security_group_members [ 867.225237] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.225355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.225432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.225645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.225814] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.225910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.226622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.226622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.226622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.226622] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.494826] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d in Status: SUCCESS [ 867.494973] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29cd0e69-d83a-4e99-940e-3b95d8bf9b2d deletion is rescheduled due to dependency. [ 867.495110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29cd0e69-d83a-4e99-940e-3b95d8bf9b2d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.597024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 867.597299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.676847] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: SUCCESS [ 867.677143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.677501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.677953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.678361] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.678838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.678838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.679116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.679323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.679484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.679909] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.728244] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.728453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.728497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.728829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.728981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.729476] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.729476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.729476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.729771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.729771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.729923] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 is going to be updated. [ 867.767673] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.767811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.767879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.769121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.769121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.783728] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 in Status: IN_PROGRESS for 2s [ 867.879476] env[65630]: INFO networking_nsxv3.common.synchronization [req-d0941db3-49ff-4ca8-8098-1bf77f7676d6 req-f4664062-6123-4ef6-a811-1f49f91d07fa service nova] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_rules [ 867.879698] env[65630]: INFO networking_nsxv3.common.synchronization [req-d0941db3-49ff-4ca8-8098-1bf77f7676d6 req-f4664062-6123-4ef6-a811-1f49f91d07fa service nova] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 867.880069] env[65630]: INFO networking_nsxv3.common.synchronization [req-d0941db3-49ff-4ca8-8098-1bf77f7676d6 req-f4664062-6123-4ef6-a811-1f49f91d07fa service nova] Enqueued Resource ID: 2084685b-be19-4bda-b631-e24e2cdbbab2 with Priority: HIGHEST for action port [ 867.880650] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_rules [ 867.880699] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 867.880818] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2084685b-be19-4bda-b631-e24e2cdbbab2 with Priority: HIGHEST for action port [ 867.881302] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.881302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.881302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.881564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.881626] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.882588] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.882979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.882979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.884064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.884247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.884376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.884445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.884625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.884738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.884839] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.890100] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2084685b-be19-4bda-b631-e24e2cdbbab2 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.890100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.890100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.890308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.890395] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2084685b-be19-4bda-b631-e24e2cdbbab2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.184250] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.392274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.392490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.393104] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.395118] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2084685b-be19-4bda-b631-e24e2cdbbab2 with status ACTIVE [ 868.395118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.395118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.395118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.395118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.395118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.395419] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.395419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.395419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.395539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.395615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.395832] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.395953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.395953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.396094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.396224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.396443] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2084685b-be19-4bda-b631-e24e2cdbbab2 is going to be updated. [ 868.423659] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.424043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.424043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.424182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.424423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.424566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2084685b-be19-4bda-b631-e24e2cdbbab2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.686184] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34ac1819-3d29-4b4e-ac83-e39408cd6e49: rpc.has_security_group_logging(os_id): False [ 868.704663] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 868.704897] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 868.704972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.716058] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.716284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.716284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.716553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.716716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.717542] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.717542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.717542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.717542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.717542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.717542] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 is going to be created. [ 868.790068] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.790068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.790342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.790391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.790580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.801697] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: IN_PROGRESS for 2s [ 868.898424] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.074338] env[65630]: INFO networking_nsxv3.common.synchronization [req-ee5e5ed3-0494-4f70-b1be-e05ddc7ed769 req-1abc3139-d335-498d-a67b-be2cff979f24 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_members [ 869.075037] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_members [ 869.075358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.075481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.075553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.076555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.076555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.076555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.076555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.076555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.076555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.076555] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.400749] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.401105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.401105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.401324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.401324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.401428] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be created. [ 869.425142] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.425352] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.425473] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.425804] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.426241] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.426460] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.426607] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.426888] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.427083] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.427326] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.427465] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.427597] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.427726] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.427859] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.427988] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.428193] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.446369] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.446520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.446594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.446814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.446974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.458259] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.458440] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.458569] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.458743] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.459089] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-05561f6f-a088-4af0-a8d1-464a788b5c4e taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.459274] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.459385] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.459713] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.459901] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05561f6f-a088-4af0-a8d1-464a788b5c4e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.466534] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: UNINITIALIZED for 2s [ 869.579362] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.579897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.579983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.580231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.580314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.580548] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.580804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.580804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.580922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.580964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.581030] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 already deleted. [ 869.581122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.796475] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 in Status: SUCCESS [ 869.796475] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 deletion is rescheduled due to dependency. [ 869.796475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.962888] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.963199] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.963325] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.963621] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.963771] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.963927] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 05561f6f-a088-4af0-a8d1-464a788b5c4e not found, creating... [ 869.964226] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.964380] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.964497] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.964708] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.964842] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.965161] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.965324] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.965440] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.965645] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.965779] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.965937] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 05561f6f-a088-4af0-a8d1-464a788b5c4e is going to be created. [ 869.986225] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.986487] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.986562] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.986833] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.987072] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.987299] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.761593] env[65630]: INFO networking_nsxv3.common.synchronization [req-ee5e5ed3-0494-4f70-b1be-e05ddc7ed769 req-1eae57b0-7bbc-4a2c-881f-7ff587fb6fcb service nova] Enqueued Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_rules [ 870.761930] env[65630]: INFO networking_nsxv3.common.synchronization [req-ee5e5ed3-0494-4f70-b1be-e05ddc7ed769 req-1eae57b0-7bbc-4a2c-881f-7ff587fb6fcb service nova] Enqueued Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_members [ 870.762117] env[65630]: INFO networking_nsxv3.common.synchronization [req-ee5e5ed3-0494-4f70-b1be-e05ddc7ed769 req-1eae57b0-7bbc-4a2c-881f-7ff587fb6fcb service nova] Enqueued Resource ID: 05561f6f-a088-4af0-a8d1-464a788b5c4e with Priority: HIGHEST for action port [ 870.762942] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_rules [ 870.763251] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_members [ 870.763375] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05561f6f-a088-4af0-a8d1-464a788b5c4e with Priority: HIGHEST for action port [ 870.763731] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.763946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.764135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.764404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.764542] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.766554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.766863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.766863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.767255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.767561] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.767781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.768420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.768420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.768581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.768763] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.770019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-05561f6f-a088-4af0-a8d1-464a788b5c4e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.770216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.770327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.770618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.770812] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05561f6f-a088-4af0-a8d1-464a788b5c4e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.818163] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: SUCCESS [ 870.818475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.277031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.277031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.277255] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.278418] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05561f6f-a088-4af0-a8d1-464a788b5c4e with status ACTIVE [ 871.278839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.278964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.278964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.279289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.279429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.279695] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.281690] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.281690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.281690] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05561f6f-a088-4af0-a8d1-464a788b5c4e is going to be updated. [ 871.306041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.306241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.306991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.306991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.306991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.306991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05561f6f-a088-4af0-a8d1-464a788b5c4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.480169] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: SUCCESS [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.480169] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.480169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.480169] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.666268] env[65630]: INFO networking_nsxv3.common.synchronization [req-a71018fc-c475-43d9-8796-f87bd8e855bc req-7ef95631-5951-4a8f-8b32-fb354c36cfd2 tempest-ServersNegativeTestMultiTenantJSON-698822446 tempest-ServersNegativeTestMultiTenantJSON-698822446-project-member] Enqueued Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_members [ 871.666896] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_members [ 871.667276] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.667465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.667537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.667906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.668117] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.668252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.668345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.668533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.668650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.668774] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.784465] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.982883] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.983929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.983929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.984290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.984554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.985350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.985490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.985816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.985816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.985996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.986234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.986384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.986476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.986812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.986930] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.987112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.987212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.990230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.990378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.990517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.990657] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.112204] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.112204] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-249" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.112204] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-249" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.112204] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-249" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.112776] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.113283] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.113814] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.114217] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.114487] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.114821] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.115065] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.115281] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.115551] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.115767] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.115974] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.116230] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.141025] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.141025] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 872.141025] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.141025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-249" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.141025] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-a525b9dc-7e33-47f7-8491-f6b0fc449989 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.141025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.141025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.141025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.141025] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a525b9dc-7e33-47f7-8491-f6b0fc449989',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.171609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.171894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.171894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.172205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.172322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.172556] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.172661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.172724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.172903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.173013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.173160] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c already deleted. [ 872.173250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.287281] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.287281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.287281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.287281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.287281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.287281] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 is going to be created. [ 872.313715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.314173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.314299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.314535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.314704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.324609] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 in Status: UNINITIALIZED for 2s [ 872.495945] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dbe819a-cf2f-494c-95fc-b507ea47e6d1: rpc.has_security_group_logging(os_id): False [ 872.521632] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.521632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.521632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.522141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.522141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.522349] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.522495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.522593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.522839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.522968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.523263] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.523411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.523501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.523720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.523824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.524180] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.524307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.524394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.524603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.524709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.524850] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be created. [ 872.597502] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.597721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.597806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.598076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.598350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.610755] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: IN_PROGRESS for 2s [ 872.649215] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.649531] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.653022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.653022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.653022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.653022] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port a525b9dc-7e33-47f7-8491-f6b0fc449989 not found, creating... [ 872.653022] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.653022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.653022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.653022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.653022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.653588] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.653659] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.653818] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.654140] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.654350] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.654538] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: a525b9dc-7e33-47f7-8491-f6b0fc449989 is going to be created. [ 872.683283] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.683283] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.683283] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.683537] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.684158] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.684158] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.461526] env[65630]: INFO networking_nsxv3.common.synchronization [req-a71018fc-c475-43d9-8796-f87bd8e855bc req-5194df83-1966-439b-962d-a1febd45c0ac service nova] Enqueued Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_rules [ 873.461834] env[65630]: INFO networking_nsxv3.common.synchronization [req-a71018fc-c475-43d9-8796-f87bd8e855bc req-5194df83-1966-439b-962d-a1febd45c0ac service nova] Enqueued Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_members [ 873.461940] env[65630]: INFO networking_nsxv3.common.synchronization [req-a71018fc-c475-43d9-8796-f87bd8e855bc req-5194df83-1966-439b-962d-a1febd45c0ac service nova] Enqueued Resource ID: a525b9dc-7e33-47f7-8491-f6b0fc449989 with Priority: HIGHEST for action port [ 873.462502] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_rules [ 873.462681] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_members [ 873.462730] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a525b9dc-7e33-47f7-8491-f6b0fc449989 with Priority: HIGHEST for action port [ 873.463020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.463168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.463461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.463536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.463592] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.464680] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.464806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.464872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.465058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.465215] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.465331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.465556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.465735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.465807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.465902] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.466804] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a525b9dc-7e33-47f7-8491-f6b0fc449989 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.466923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.466991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.471019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.471019] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a525b9dc-7e33-47f7-8491-f6b0fc449989',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.969409] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.970546] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.970709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.971008] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a525b9dc-7e33-47f7-8491-f6b0fc449989 with status ACTIVE [ 873.971179] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.971286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.971346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.971554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.971723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.971803] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.971900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.971962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.972133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.972205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.972384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.972475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.972533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.972677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.972749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.972824] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a525b9dc-7e33-47f7-8491-f6b0fc449989 is going to be updated. [ 873.996080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.996080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.996080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.996759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.996759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.996759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a525b9dc-7e33-47f7-8491-f6b0fc449989" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.368990] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 in Status: SUCCESS [ 874.369265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.369451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.369692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.369926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.370071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.370131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.370301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.370387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.370479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.370582] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.472583] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.537372] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2028edd-8af0-4921-b44c-8861150a352f req-6a71aea7-a8d6-4c37-9d84-8f29909b78b6 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 874.537928] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 874.538202] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.538414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.538481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.540100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.540845] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.540988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.540988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.541528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.541528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.541528] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.631558] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: SUCCESS [ 874.631933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.874783] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.976546] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.976718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.976789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.977130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.977130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.977226] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c is going to be created. [ 875.012956] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.013136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.013227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.013453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.013630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.029431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c in Status: UNINITIALIZED for 2s [ 875.048629] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.048863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.048863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.049251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.049314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.049535] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.049669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.050764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.050764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.050764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.050764] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f already deleted. [ 875.050764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.155302] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.155302] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.155581] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.155849] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.155974] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.156897] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.156897] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.157070] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.157132] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.157696] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.157696] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.157696] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.157872] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.157872] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.158106] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.158277] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.188582] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.188867] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.189069] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.189366] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.189877] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-167f5f71-b204-46e8-88fb-911a284a114d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.193983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.193983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.193983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.193983] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('167f5f71-b204-46e8-88fb-911a284a114d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.377775] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a871646-acc8-47a5-a5e8-6672ff7eb295: rpc.has_security_group_logging(os_id): False [ 875.414535] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.416058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.416058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.416608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.416608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.416608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.417089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.417089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.417556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.417673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.417797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 is going to be created. [ 875.513611] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.514071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.514071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.514848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.515086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.533201] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 in Status: IN_PROGRESS for 2s [ 875.696936] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.697256] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.697483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.697825] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.698025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.698214] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 167f5f71-b204-46e8-88fb-911a284a114d not found, creating... [ 875.698527] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.698701] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.698827] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.699647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.699838] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.700201] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.700372] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.700489] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.700735] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.700870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.701017] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 167f5f71-b204-46e8-88fb-911a284a114d is going to be created. [ 875.731069] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.731294] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.731435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.731875] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.732135] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.732371] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.948878] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9b38f50c-b4a4-4705-9503-2f75758dffe9 tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_rules [ 875.949252] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_rules [ 875.949573] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.949704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.949791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.950384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.950384] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.113034] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7f9088d6-23ea-4a1b-a217-8e6080ad0952 tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_rules [ 876.113759] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_rules [ 876.113943] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.114066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.461891] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2028edd-8af0-4921-b44c-8861150a352f req-7812546e-aff8-4527-af2c-032698cf09ff service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 876.462089] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2028edd-8af0-4921-b44c-8861150a352f req-7812546e-aff8-4527-af2c-032698cf09ff service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 876.462181] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2028edd-8af0-4921-b44c-8861150a352f req-7812546e-aff8-4527-af2c-032698cf09ff service nova] Enqueued Resource ID: 167f5f71-b204-46e8-88fb-911a284a114d with Priority: HIGHEST for action port [ 876.462699] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 876.462842] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 876.462968] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 167f5f71-b204-46e8-88fb-911a284a114d with Priority: HIGHEST for action port [ 876.463412] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.463538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.463606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.463873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.463957] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.464929] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.465066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.465136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.465319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.465468] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.465562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.465623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.465763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.465849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.465954] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.473366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-167f5f71-b204-46e8-88fb-911a284a114d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.473559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.473633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.473838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.473921] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('167f5f71-b204-46e8-88fb-911a284a114d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.475794] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.475915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.476013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.476841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.476841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.476841] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 044f1395-427c-4906-bf47-71c561e2457d already deleted. [ 876.476841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.478242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.478537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.479063] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.920613] env[65630]: INFO networking_nsxv3.common.synchronization [req-42f9184a-6f43-48f7-bfe9-193ff5441351 req-cb47037f-f182-46bc-ab8b-6bee2fe2ad21 tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 876.921209] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 876.921510] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.921625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.921687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.922261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.922261] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.922261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.922261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.923548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.923548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.923548] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.976179] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.977214] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.977394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.980985] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 167f5f71-b204-46e8-88fb-911a284a114d with status ACTIVE [ 876.981643] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.981643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.981643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.981643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.981643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.982068] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.982068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.982068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.982817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.982817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.982817] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.982817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.982817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.982817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.982817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.983506] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 167f5f71-b204-46e8-88fb-911a284a114d is going to be updated. [ 877.003793] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.003940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.004011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.004231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.004339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.008020] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 044f1395-427c-4906-bf47-71c561e2457d already deleted. [ 877.008020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.008020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.008020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.008020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.008020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.008020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.008020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-167f5f71-b204-46e8-88fb-911a284a114d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.040908] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c in Status: SUCCESS [ 877.041170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.041344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.041580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.041731] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.041905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.041970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.042141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.042221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.042307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.042396] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.318611] env[65630]: INFO networking_nsxv3.common.synchronization [req-bdf3fee3-c1d1-4467-b277-6add3dc39714 req-0abbbd2c-03e1-4954-92c9-a13906c3aded tempest-ServersNegativeTestJSON-111815627 tempest-ServersNegativeTestJSON-111815627-project-member] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 877.319840] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 877.320366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.320526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.320699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.320962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.321251] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.321488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.321488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.321730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.321968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.321968] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.426157] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.478304] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.544741] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.544924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.545017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.545219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.545448] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.545576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.545665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.546110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.546110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.546110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.546110] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.546448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.547312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.550049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.550049] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.550049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.550049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.550049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.550049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.550726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.550726] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.553287] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 in Status: SUCCESS [ 877.553287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.712059] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.712059] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.712059] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.712440] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.712743] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.713082] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.713160] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.713425] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.713834] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.714396] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.714396] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.714553] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.714892] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.715417] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.715417] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.715594] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.737455] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.737635] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 877.737780] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.738102] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.738607] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.738889] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.739076] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.739441] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.740987] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.826035] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.934076] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.981460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.981460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.981460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.981783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.981783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.981906] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be created. [ 878.010784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.010890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.010931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.011942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.011942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.023862] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: UNINITIALIZED for 2s [ 878.053368] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d49103b2-0d3b-4f56-8ce6-a2ba4306895c: rpc.has_security_group_logging(os_id): False [ 878.071649] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.071788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.071788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.072057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.072185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.072507] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.072705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.072768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.073166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.073166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.073450] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.073584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.073692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.073887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.073968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.074194] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.074297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.074364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.074510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.074585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.074670] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c is going to be created. [ 878.137079] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.137309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.137309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.137501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.137688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.151609] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c in Status: IN_PROGRESS for 2s [ 878.243130] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.243266] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.243345] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.243628] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.243758] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.243917] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 not found, creating... [ 878.244218] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.244355] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.244472] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.244699] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.244853] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.245134] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.245288] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.245577] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.245789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.245923] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.246076] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 is going to be created. [ 878.281545] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.281753] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.281979] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.282323] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.282548] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.282775] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.328456] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.439246] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.439246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.439246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.439246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.439246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.439246] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 878.487426] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.487426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.487426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.487426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.487426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.499244] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 878.831677] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.831930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.832080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.832391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.832536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.832845] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be updated. [ 878.865933] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.866136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.866219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.866515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.866590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.879567] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 879.059840] env[65630]: INFO networking_nsxv3.common.synchronization [req-bdf3fee3-c1d1-4467-b277-6add3dc39714 req-a5f8d976-7dde-46ea-ad74-e7cc26104e02 service nova] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_rules [ 879.059840] env[65630]: INFO networking_nsxv3.common.synchronization [req-bdf3fee3-c1d1-4467-b277-6add3dc39714 req-a5f8d976-7dde-46ea-ad74-e7cc26104e02 service nova] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 879.059840] env[65630]: INFO networking_nsxv3.common.synchronization [req-bdf3fee3-c1d1-4467-b277-6add3dc39714 req-a5f8d976-7dde-46ea-ad74-e7cc26104e02 service nova] Enqueued Resource ID: b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 with Priority: HIGHEST for action port [ 879.061321] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_rules [ 879.062085] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 879.062227] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 with Priority: HIGHEST for action port [ 879.063416] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.063416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.063416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.064356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.064356] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.068959] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.068959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.068959] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.068959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.068959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.068959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.068959] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.566987] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.567148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.571613] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 with status ACTIVE [ 879.571887] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.572028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.572094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.572329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.572424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.572616] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.572715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.572778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.572987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.573088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.573287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.573386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.573449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.573603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.573677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.573766] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8 is going to be updated. [ 879.600384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.600571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.600619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.600807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.600943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.601128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5d3a835-9cae-46e3-9bce-4d2d8e0e5cd8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.038380] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 880.038791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.039081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.039425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.039651] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.039821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.039970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.040197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.040330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.040466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.040603] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.177127] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c in Status: SUCCESS [ 880.177127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.512019] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 880.512324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.543728] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.543728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.543728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.543728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.543923] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.543923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.543923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.544058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.544146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.544237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.544387] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.544482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.544616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.544688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.544823] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.544926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.544967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.545129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.545205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.545301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.545366] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.890926] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 880.892150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.892150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.892150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.892911] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.892911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.892911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.892911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.892911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.892911] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.050325] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d84857eb-b557-4aa2-8d62-34137b9cab1f: rpc.has_security_group_logging(os_id): False [ 881.069437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.069638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.069771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.070022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.070201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.070765] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.070765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.070765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.070966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.070966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.071076] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.071155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.071246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.071464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.071582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.071774] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.071893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.071968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.072987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.073145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.073293] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be created. [ 881.143751] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.144032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.144032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.144247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.144408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.157736] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 881.401031] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.903872] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.409617] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.410051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.410051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.410146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.410275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.410413] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be updated. [ 882.442616] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.442804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.442855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.443063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.443213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.453236] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 883.171976] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 883.172230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.204284] env[65630]: INFO networking_nsxv3.common.synchronization [None req-55542cea-48e8-4057-badf-6b085d8e452f tempest-MigrationsAdminTest-1222576144 tempest-MigrationsAdminTest-1222576144-project-member] Enqueued Resource ID: 0ebdeb75-cd4f-4c66-ad63-e65da644beff with Priority: HIGHEST for action security_group_rules [ 883.204802] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ebdeb75-cd4f-4c66-ad63-e65da644beff with Priority: HIGHEST for action security_group_rules [ 883.205249] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.205249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.205424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.206483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.206483] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ebdeb75-cd4f-4c66-ad63-e65da644beff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.297389] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7ddc51f1-52a8-49cb-938f-4edc76dd769d tempest-MigrationsAdminTest-1222576144 tempest-MigrationsAdminTest-1222576144-project-member] Enqueued Resource ID: 0ebdeb75-cd4f-4c66-ad63-e65da644beff with Priority: HIGHEST for action security_group_rules [ 883.298018] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ebdeb75-cd4f-4c66-ad63-e65da644beff with Priority: HIGHEST for action security_group_rules [ 883.298361] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.298484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.728098] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.728434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.728434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.728523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.728606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.728726] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ebdeb75-cd4f-4c66-ad63-e65da644beff already deleted. [ 883.728775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.728932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.729138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.729936] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ebdeb75-cd4f-4c66-ad63-e65da644beff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.071241] env[65630]: INFO networking_nsxv3.common.synchronization [req-15fe2ee1-ce4d-4bef-9f5b-46d3c22a1556 req-fbd4b0f0-ea0a-45e5-8355-97cef272afac tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 884.071873] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 884.072237] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.072372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.072446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.072664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.072819] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.072921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.072985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.073218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.073273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.073370] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.251532] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.251686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.251774] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.252097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.252179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.252277] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ebdeb75-cd4f-4c66-ad63-e65da644beff already deleted. [ 884.252366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ebdeb75-cd4f-4c66-ad63-e65da644beff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.470024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 884.470332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.470578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.470910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.471233] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.471424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.471543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.471814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.472020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.472177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.472339] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.575186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.575381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.575432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.575657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.575748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.575957] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.576092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.576158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.576274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.576339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.576437] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be updated. [ 884.605839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.606060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.606209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.606372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.606540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.616617] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 884.978101] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.978101] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.978101] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.978101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.979672] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.980035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.982077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.982077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.982077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.982077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.982077] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.484447] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57e44ebf-431f-48ef-9d59-768d3bda2cbd: rpc.has_security_group_logging(os_id): False [ 885.505740] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.505919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.506197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.506291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.532460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.532795] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.532943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.533027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.533423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.533423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.533547] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.533622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.533740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.533860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.534022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.534453] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.534582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.534656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.534835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.534918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.535096] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be updated. [ 885.614875] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.615104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.615201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.615465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.615683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.632151] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 886.637800] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 886.638114] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e deletion is rescheduled due to dependency. [ 886.638114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.322724] env[65630]: INFO networking_nsxv3.common.synchronization [req-1b83e89d-9248-4c12-99d1-1014c8258c2a req-dfb4097d-c50c-41c8-baac-083559381a74 tempest-ServersNegativeTestMultiTenantJSON-698822446 tempest-ServersNegativeTestMultiTenantJSON-698822446-project-member] Enqueued Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_members [ 887.324335] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGHEST for action security_group_members [ 887.324335] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.324788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.324788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.325200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.325644] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.325813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.325926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.326226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.326384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.326566] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.591232] env[65630]: INFO networking_nsxv3.common.synchronization [req-023b048a-0a38-4b62-8079-4726cebab952 req-2f2544ae-496b-42d1-aab8-97f85c3e1d8c tempest-ListImageFiltersTestJSON-1975870512 tempest-ListImageFiltersTestJSON-1975870512-project-member] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 887.592526] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 887.592526] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.592526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.592526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.592812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.592812] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.594253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.594373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.594679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.594816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.594946] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.656105] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 887.656549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.829837] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.829837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.829837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.829837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.829837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.830207] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.830290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.830376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.831024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.831024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.831024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c is going to be updated. [ 887.867374] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.867374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.867374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.867374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.867374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.876391] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c in Status: IN_PROGRESS for 2s [ 888.097089] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.602663] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.057445] env[65630]: INFO networking_nsxv3.common.synchronization [req-68ee108c-2eac-4506-9f68-e342966b8fac req-87bd8b7f-6979-4683-9830-faa1e8e22ec0 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 889.058016] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 889.058342] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.058523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.058594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.058809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.058959] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.059136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.059136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.059275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.059362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.059454] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.105893] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.106902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.106902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.106902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.106902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.106902] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be updated. [ 889.144749] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.144749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.144749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.145053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.145092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.156565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: IN_PROGRESS for 2s [ 889.439858] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.439974] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.440118] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.440389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.440652] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.440814] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.440927] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.441170] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.441318] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.441527] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.441635] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.441786] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.441836] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.441980] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.442132] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.442274] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.467033] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.467033] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 889.467033] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.467033] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-725" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.467452] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-89b5f930-5996-401f-9d9e-12cc0a93f3ef taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.467649] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.467773] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.468148] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.468292] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b5f930-5996-401f-9d9e-12cc0a93f3ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.561719] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.890196] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c in Status: SUCCESS [ 889.890355] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c deletion is rescheduled due to dependency. [ 889.890465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.971215] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.971436] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.971653] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.971817] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.971999] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.972256] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 89b5f930-5996-401f-9d9e-12cc0a93f3ef not found, creating... [ 889.972488] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.972648] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.972764] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.973018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.973150] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.973434] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.973607] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.973754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.973975] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.974124] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.974286] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef is going to be created. [ 889.994697] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.994912] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.995053] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.995333] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.996030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.996030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.064061] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.570588] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.570795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.571120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.571303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.571303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.571427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 890.620282] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.620544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.620544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.620773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.620863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.640534] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 890.715931] env[65630]: INFO networking_nsxv3.common.synchronization [req-e66bb6c3-8e12-4193-9155-a85efada13e7 req-d962e87a-5db2-4803-94f9-2a4bb10b7525 tempest-ServersWithSpecificFlavorTestJSON-478407304 tempest-ServersWithSpecificFlavorTestJSON-478407304-project-member] Enqueued Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_members [ 890.716914] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGHEST for action security_group_members [ 890.717330] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.717330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.717330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.717689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.718133] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.719219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.719219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.719219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.719219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.719219] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.817632] env[65630]: INFO networking_nsxv3.common.synchronization [req-68ee108c-2eac-4506-9f68-e342966b8fac req-486e6132-7a66-41c8-80b6-3661e03b6b58 service nova] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 890.817861] env[65630]: INFO networking_nsxv3.common.synchronization [req-68ee108c-2eac-4506-9f68-e342966b8fac req-486e6132-7a66-41c8-80b6-3661e03b6b58 service nova] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 890.818227] env[65630]: INFO networking_nsxv3.common.synchronization [req-68ee108c-2eac-4506-9f68-e342966b8fac req-486e6132-7a66-41c8-80b6-3661e03b6b58 service nova] Enqueued Resource ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef with Priority: HIGHEST for action port [ 890.818597] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 890.818731] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 890.818908] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef with Priority: HIGHEST for action port [ 890.819414] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.819609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.819609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.820047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.820047] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.821040] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.821040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.821207] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b5f930-5996-401f-9d9e-12cc0a93f3ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.821299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.821454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.821558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.821630] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b5f930-5996-401f-9d9e-12cc0a93f3ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.168803] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 891.169177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.221663] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.221852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.221966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.222321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.245433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.245729] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.245855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.245922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.246193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.246278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.246378] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d is going to be updated. [ 891.278437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.279043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.279043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.279043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.279043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.288936] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d in Status: IN_PROGRESS for 2s [ 891.323703] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.323898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.324076] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89b5f930-5996-401f-9d9e-12cc0a93f3ef with status ACTIVE [ 891.324234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.324351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.324436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.324765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.324862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.325217] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.325217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.325419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.325419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.325654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.325733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.325842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.325842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.325997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.326100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.326179] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef is going to be updated. [ 891.370803] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.370971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.371072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.371310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.371435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.371604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.655276] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 892.655276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.655276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.655276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.655276] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.655276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.655276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.655276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.655276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.655276] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.160549] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.301084] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d in Status: SUCCESS [ 893.301313] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d deletion is rescheduled due to dependency. [ 893.301479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.662572] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.165719] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.166103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.166103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.166431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.166569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.166837] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 894.207331] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.207494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.207573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.207788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.207940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.219394] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 894.383711] env[65630]: INFO networking_nsxv3.common.synchronization [req-03263f04-c103-4024-8357-d93ac369c90b req-561c9898-18cf-4774-849d-ea5019d99a8a tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 894.384476] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 894.384828] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.384957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.385515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.385773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.385955] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.386091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.386179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.386354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.386446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.386545] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.655567] env[65630]: INFO networking_nsxv3.common.synchronization [req-3fad2803-c7ee-4aca-93be-d964aa4f3f12 req-c2c60a5e-ceac-43d3-be0b-ada9e623a19f tempest-ListServerFiltersTestJSON-678265133 tempest-ListServerFiltersTestJSON-678265133-project-member] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 894.657177] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 894.657951] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.658160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.658266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.658529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.658736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.658861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.658947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.659130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.659247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.659378] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.661970] env[65630]: INFO networking_nsxv3.common.synchronization [req-6eaa1498-3eae-41dc-9738-760ec7ce4c03 req-5b7fa8f8-4c18-476d-98b2-a058e0cc8824 tempest-ServersNegativeTestJSON-111815627 tempest-ServersNegativeTestJSON-111815627-project-member] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 894.662663] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 894.663620] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.663620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.663620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.663620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.663620] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.663868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.663868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.663940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.663978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.664117] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.889555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.890592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.890692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.890934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.892050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.892050] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.892050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.892050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.892050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.892050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.892050] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 894.927489] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.927693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.927693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.927913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.928063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.938465] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 895.061840] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.062128] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.062313] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.062704] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.063107] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.063354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.063527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.063852] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.064080] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.064379] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.064551] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.064718] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.064882] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.065074] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.065246] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.065446] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.094440] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.094731] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.094957] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.095304] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.095780] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.096085] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.096290] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.096857] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.097152] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5fa672c-f989-4677-9ed6-54f7a8ff69ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.163307] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.167161] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.602645] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.602959] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.603134] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.603408] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.603564] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.603773] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port e5fa672c-f989-4677-9ed6-54f7a8ff69ff not found, creating... [ 895.604037] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.604203] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.604339] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.604596] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.604735] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.605062] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.605260] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.605385] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.605612] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.605790] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.605949] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: e5fa672c-f989-4677-9ed6-54f7a8ff69ff is going to be created. [ 895.634450] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.634677] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.634771] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.635100] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.635376] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.635618] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.665703] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.669039] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.168736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.168905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.168995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.169483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.169483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.169483] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 896.173031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.173031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.173031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.173031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.173031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.173031] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be updated. [ 896.207064] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.207264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.207345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.207570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.207715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.210109] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.210247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.210289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.210479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.210614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.221258] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 896.222415] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 896.230853] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 896.230910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.231099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.231351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.231551] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.231673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.231740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.231898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.232011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.232104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.232202] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.349099] env[65630]: INFO networking_nsxv3.common.synchronization [req-03263f04-c103-4024-8357-d93ac369c90b req-bfa4a77d-c341-47a8-829c-d1cc009f7a8a service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 896.349339] env[65630]: INFO networking_nsxv3.common.synchronization [req-03263f04-c103-4024-8357-d93ac369c90b req-bfa4a77d-c341-47a8-829c-d1cc009f7a8a service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 896.349492] env[65630]: INFO networking_nsxv3.common.synchronization [req-03263f04-c103-4024-8357-d93ac369c90b req-bfa4a77d-c341-47a8-829c-d1cc009f7a8a service nova] Enqueued Resource ID: e5fa672c-f989-4677-9ed6-54f7a8ff69ff with Priority: HIGHEST for action port [ 896.350253] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 896.350447] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 896.350673] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5fa672c-f989-4677-9ed6-54f7a8ff69ff with Priority: HIGHEST for action port [ 896.351080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.351341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.351437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.351716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.351856] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.353271] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.353271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.353609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.353823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.353980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.354407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.354495] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5fa672c-f989-4677-9ed6-54f7a8ff69ff',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.735154] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.735154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.735765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.735765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.735765] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.735765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.736132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.736132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.736132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.736289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.736390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.736484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.736553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.736737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.736877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.737012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.737080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.737255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.737351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.737430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.737539] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.858458] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.858458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.858458] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5fa672c-f989-4677-9ed6-54f7a8ff69ff with status ACTIVE [ 896.858458] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.858458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.858458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.858458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.858458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.858916] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.858916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.858916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.859127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.859261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.859520] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.859636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.859739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.859976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.860083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.860201] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5fa672c-f989-4677-9ed6-54f7a8ff69ff is going to be updated. [ 896.890832] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.890832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.890832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.890832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.890832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.890832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5fa672c-f989-4677-9ed6-54f7a8ff69ff" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.958433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 896.958638] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 896.958763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.958940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.959191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.959380] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.959504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.959570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.959737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.959822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.959917] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.243035] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a73db6d-e930-47a9-9dbe-748ef759f251: rpc.has_security_group_logging(os_id): False [ 897.263362] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.263534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.263602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.263826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.289703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.290125] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.290285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.290285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.290437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.290573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.290756] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.290942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.290942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.291263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.291263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.291473] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.291572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.291640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.291805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.291885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.292401] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 897.372094] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.372094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.372094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.372094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.372094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.409605] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 897.463448] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.966477] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.236279] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 898.236279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.237336] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 898.237336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.470902] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.470902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.470902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.470902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.470902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.470902] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 898.527143] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.527143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.527143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.527367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.527533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.538125] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 899.032584] env[65630]: INFO networking_nsxv3.common.synchronization [req-2defb968-684a-460c-b530-976f6239134a req-aec89e2f-63c9-4b41-8fb1-ef6605388e9b tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 899.032879] env[65630]: INFO networking_nsxv3.common.synchronization [req-2defb968-684a-460c-b530-976f6239134a req-aec89e2f-63c9-4b41-8fb1-ef6605388e9b tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 899.033448] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 899.033683] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 899.033942] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.034084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.034151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.034398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.034596] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.034741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.034835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.035057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.035148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.035263] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.036141] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.036319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.036319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.036518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.036658] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.036752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.036813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.037130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.038453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.038611] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.084371] env[65630]: INFO networking_nsxv3.common.synchronization [req-2defb968-684a-460c-b530-976f6239134a req-aec89e2f-63c9-4b41-8fb1-ef6605388e9b tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_rules [ 899.084557] env[65630]: INFO networking_nsxv3.common.synchronization [req-2defb968-684a-460c-b530-976f6239134a req-aec89e2f-63c9-4b41-8fb1-ef6605388e9b tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 899.084691] env[65630]: INFO networking_nsxv3.common.synchronization [req-2defb968-684a-460c-b530-976f6239134a req-aec89e2f-63c9-4b41-8fb1-ef6605388e9b tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 899.084819] env[65630]: INFO networking_nsxv3.common.synchronization [req-2defb968-684a-460c-b530-976f6239134a req-aec89e2f-63c9-4b41-8fb1-ef6605388e9b tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 899.084940] env[65630]: INFO networking_nsxv3.common.synchronization [req-2defb968-684a-460c-b530-976f6239134a req-aec89e2f-63c9-4b41-8fb1-ef6605388e9b tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef with Priority: HIGHEST for action port [ 899.085594] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_rules [ 899.085734] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 899.085838] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef with Priority: HIGHEST for action port [ 899.086050] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 899.086050] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 899.086366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.128428] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.128428] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.128428] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b5f930-5996-401f-9d9e-12cc0a93f3ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.128428] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b5f930-5996-401f-9d9e-12cc0a93f3ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.128428] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.128428] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.128428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.541467] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.542561] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.595645] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.595645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.595645] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89b5f930-5996-401f-9d9e-12cc0a93f3ef with status ACTIVE [ 899.595798] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.595921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.596012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.596334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.596494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.596776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.596930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.597074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.597335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.597485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.597736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.597844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.597910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.598098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.598186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.598284] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef is going to be updated. [ 899.658968] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.659136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.659208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.659466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.659563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.659725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.660515] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 899.660698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.660854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.661040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.661136] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.047735] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.048810] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.164263] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.164451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.549657] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 900.549914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.550418] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.550639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.550639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.550854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.550971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.551119] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be created. [ 900.552494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.552721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.552874] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.553012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.553087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.553253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.553334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.553421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.553565] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.554818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.554958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.555038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.555203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.555288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.555387] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 900.598928] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.599166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.599247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.599464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.599643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.604212] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.604437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.604497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.604709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.605063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.613897] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: UNINITIALIZED for 2s [ 900.614916] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 901.058572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.059523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.059523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.059523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.059523] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.059707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.059707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.059827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.059967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.060107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.060298] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.060399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.060484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.060690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.060916] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.061075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.061203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.061357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.061491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.061590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.061703] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.248792] env[65630]: INFO networking_nsxv3.common.synchronization [None req-23688883-7a59-4d45-941a-b987e6311514 None None] Enqueued Resource ID: 1ae0615c-1969-4e6c-ab70-db4049916940 with Priority: HIGHEST for action port [ 901.249556] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae0615c-1969-4e6c-ab70-db4049916940 with Priority: HIGHEST for action port [ 901.250110] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ae0615c-1969-4e6c-ab70-db4049916940 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.250110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ae0615c-1969-4e6c-ab70-db4049916940" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.250110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ae0615c-1969-4e6c-ab70-db4049916940" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.250669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ae0615c-1969-4e6c-ab70-db4049916940" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.250805] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ae0615c-1969-4e6c-ab70-db4049916940',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.565877] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14b62121-4e0b-44ce-9aab-8ed6b4024ea4: rpc.has_security_group_logging(os_id): False [ 901.609583] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.609766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.609872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.610144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.610240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.610454] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.610588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.610637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.610774] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.610846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.611074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.611178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.611241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.611368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.611437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.611628] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.611732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.611774] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.613044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.613044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.613044] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 901.691609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.691609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.691609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.691837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.691933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.717726] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 901.754216] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ae0615c-1969-4e6c-ab70-db4049916940 [ 901.754931] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.755369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.755597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.756125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.756427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.756672] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ae0615c-1969-4e6c-ab70-db4049916940 already deleted. [ 901.757067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ae0615c-1969-4e6c-ab70-db4049916940" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.628056] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 902.628056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.628526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.628740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.628923] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.629051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.629121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.629279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.629358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.629463] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.630930] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: SUCCESS [ 902.631132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.631275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.631449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.631619] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.631725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.631790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.631931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.632041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.632169] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.908816] env[65630]: INFO networking_nsxv3.common.synchronization [None req-8e7065d3-5fc6-420b-966e-d781ea0ca7ff tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 902.910288] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 902.910720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.911440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.911440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.911440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.911440] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.111916] env[65630]: INFO networking_nsxv3.common.synchronization [None req-fa3978a4-e058-4c3f-b4f5-e625f8c8b64f tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 903.112501] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 903.112846] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.112982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.135363] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.135363] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.436858] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.436858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.436858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.436858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.436858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.436858] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d already deleted. [ 903.436858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.437191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.437219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.437305] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.640069] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.641553] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.738069] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 903.738069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.963386] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.963510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.963546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.964024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.964024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.964024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d already deleted. [ 903.964144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.003837] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5e76c093-944e-485a-aa7a-e3deea7137f9 None None] Enqueued Resource ID: ddfc5d13-14d2-4720-9777-a04d7f5800be with Priority: HIGHEST for action port [ 904.003837] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddfc5d13-14d2-4720-9777-a04d7f5800be with Priority: HIGHEST for action port [ 904.003837] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddfc5d13-14d2-4720-9777-a04d7f5800be taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.004060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddfc5d13-14d2-4720-9777-a04d7f5800be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.004060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddfc5d13-14d2-4720-9777-a04d7f5800be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.007068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddfc5d13-14d2-4720-9777-a04d7f5800be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.007068] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddfc5d13-14d2-4720-9777-a04d7f5800be',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.144017] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.144208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.144277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.144538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.144635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.144736] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 904.146141] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.146256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.146323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.146493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.146575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.146686] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be updated. [ 904.180462] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.180462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.180462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.180756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.180802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.182685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.182685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.182685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.183245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.185085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.197287] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: IN_PROGRESS for 2s [ 904.198781] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 904.245180] env[65630]: INFO networking_nsxv3.common.synchronization [req-a00bddc7-5285-4b65-b82c-ca9615b2af70 req-de599982-4df8-47e2-b099-c2e4e389a8da tempest-DeleteServersAdminTestJSON-1326035621 tempest-DeleteServersAdminTestJSON-1326035621-project-member] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 904.245836] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 904.248260] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.248406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.248476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.248732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.248912] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.249055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.249125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.249298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.249395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.249503] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.509161] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddfc5d13-14d2-4720-9777-a04d7f5800be [ 904.509347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.509463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.510043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.510043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.510043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.510043] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddfc5d13-14d2-4720-9777-a04d7f5800be already deleted. [ 904.510588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddfc5d13-14d2-4720-9777-a04d7f5800be" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.643315] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.643575] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.645020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.645020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.645020] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.645020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.645020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.645020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.645020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.645280] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.645280] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.645280] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.645415] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.645518] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.645619] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.645750] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.669666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.669826] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.669987] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.670189] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.670511] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.672096] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.672096] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.672096] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.672096] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc17f27-394a-4bd9-ac55-2ad6e3af66e2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.751557] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.752644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.753674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.754508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.779866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.782147] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.782147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.782147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.782147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.782147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.782147] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be updated. [ 904.813982] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.814278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.814278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.814527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.814687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.827589] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: IN_PROGRESS for 2s [ 905.174624] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.174847] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.174961] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.175355] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.175517] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.175679] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 not found, creating... [ 905.175950] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.176131] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.176265] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.176440] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.176575] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.176862] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.177031] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.177140] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.177344] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.177477] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.177618] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 is going to be created. [ 905.215434] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.215859] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.215859] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.216112] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.216361] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.216598] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.276047] env[65630]: INFO networking_nsxv3.common.synchronization [req-b50c365c-5d46-4910-8f1c-91035eb6bff8 req-e2ae4aeb-09f7-4e9d-9627-12ec156d9a4e tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_members [ 905.276659] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGHEST for action security_group_members [ 905.276979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.277199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.277199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.277444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.277682] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.277782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.277830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.278027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.278112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.278220] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.780899] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.781336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.781336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.781427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.806730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.807144] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.807328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.807429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.807715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.808028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.808028] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b is going to be updated. [ 905.853352] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.853517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.853566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.853749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.853897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.865455] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b in Status: IN_PROGRESS for 2s [ 905.997798] env[65630]: INFO networking_nsxv3.common.synchronization [req-a00bddc7-5285-4b65-b82c-ca9615b2af70 req-0d176ed6-1bd5-45bf-8145-dbe67f6e569c service nova] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_rules [ 905.997798] env[65630]: INFO networking_nsxv3.common.synchronization [req-a00bddc7-5285-4b65-b82c-ca9615b2af70 req-0d176ed6-1bd5-45bf-8145-dbe67f6e569c service nova] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 905.998031] env[65630]: INFO networking_nsxv3.common.synchronization [req-a00bddc7-5285-4b65-b82c-ca9615b2af70 req-0d176ed6-1bd5-45bf-8145-dbe67f6e569c service nova] Enqueued Resource ID: ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 with Priority: HIGHEST for action port [ 906.000346] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_rules [ 906.000613] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 906.000682] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 with Priority: HIGHEST for action port [ 906.001021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.001175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.001238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.001474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.001555] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.003025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.003128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.003336] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.003518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.003518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.006272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.006272] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc17f27-394a-4bd9-ac55-2ad6e3af66e2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.210657] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: SUCCESS [ 906.210657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.210657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.210657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.210657] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.210829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.210829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.211687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.211687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.211687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.211687] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.214662] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 906.214662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.215456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.215693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.215899] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.215966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.216827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.216827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.216827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.216827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.216827] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.506266] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.506410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.513023] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 with status ACTIVE [ 906.513023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.513023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.513023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.513023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.513023] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffc17f27-394a-4bd9-ac55-2ad6e3af66e2 is going to be updated. [ 906.551032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.551190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.551258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.551471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.551621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.551823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffc17f27-394a-4bd9-ac55-2ad6e3af66e2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.554894] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 906.555207] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_members [ 906.555289] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 906.555913] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 906.556045] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_members [ 906.556133] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 906.556833] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.556833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.556833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.556833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.557083] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.557135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.557230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.557356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.557658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.557658] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.558593] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-88d71553-69de-412d-9249-d3adff7aa4e7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.558688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.558722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.558943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.559513] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.559631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.559717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.559873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.559998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.560656] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.565534] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.566538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.566538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.566538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.566538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.566538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.566707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.566740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.567286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.567286] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.612021] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_rules [ 906.612021] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 906.612021] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 906.612021] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 906.612021] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_rules [ 906.612021] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_members [ 906.612021] env[65630]: INFO networking_nsxv3.common.synchronization [req-c799b834-d92a-4342-aee4-c5886a1a05ca req-37866515-05ca-4c12-83c2-7d4919eb38be tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef with Priority: HIGHEST for action port [ 906.612460] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_rules [ 906.612821] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_rules [ 906.613135] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_members [ 906.613332] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef with Priority: HIGHEST for action port [ 906.613500] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_rules [ 906.613685] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 906.613856] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 906.615496] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.615628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.616041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.616626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.616626] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-88d71553-69de-412d-9249-d3adff7aa4e7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.616626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.616752] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b5f930-5996-401f-9d9e-12cc0a93f3ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.616832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.616976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.617196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.617250] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b5f930-5996-401f-9d9e-12cc0a93f3ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.618603] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88d71553-69de-412d-9249-d3adff7aa4e7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.618603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.618603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.618842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.618930] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.619771] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.619868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.620465] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.620549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.718275] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.722388] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.722745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.839711] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: SUCCESS [ 906.840270] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 deletion is rescheduled due to dependency. [ 906.840270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.840270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.840517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.840693] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.842109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.842109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.842109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.842109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.842109] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.069456] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.070946] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.072315] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.121986] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89b5f930-5996-401f-9d9e-12cc0a93f3ef with status ACTIVE [ 907.122419] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.122591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.122643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.122872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.122981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.123382] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.123491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.123591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.123875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.123875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.124024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.124139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.124178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.124322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.124395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.124511] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89b5f930-5996-401f-9d9e-12cc0a93f3ef is going to be updated. [ 907.125808] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-88d71553-69de-412d-9249-d3adff7aa4e7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.125874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.155699] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.155839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.155910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.156153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.156311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.156488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b5f930-5996-401f-9d9e-12cc0a93f3ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.220524] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b6e41ae-02b7-4285-8dd1-1d78634488b5: rpc.has_security_group_logging(os_id): False [ 907.239505] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.239653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.239712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.239935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.240332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.240332] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.240439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.240439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.240572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.240651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.240744] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be created. [ 907.333063] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.333063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.333063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.333063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.333063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.345361] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.363947] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: IN_PROGRESS for 2s [ 907.572813] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.573821] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.574668] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.849235] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.876692] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b in Status: SUCCESS [ 907.876908] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b deletion is rescheduled due to dependency. [ 907.877040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.076696] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.077043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.077161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.077410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.077495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.077622] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 908.079432] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.079609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.079715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.079922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.080044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.080178] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be updated. [ 908.081384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.081517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.081699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.081841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.081914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.082017] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88d71553-69de-412d-9249-d3adff7aa4e7 is going to be created. [ 908.128629] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.128854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.128854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.129143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.129221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.132697] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.132840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.132902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.133116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.133264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.135645] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.135936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.135936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.135936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.136089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.159175] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88d71553-69de-412d-9249-d3adff7aa4e7 in Status: UNINITIALIZED for 2s [ 908.165125] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 908.167186] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: IN_PROGRESS for 2s [ 908.352459] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.352459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.352459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.352674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.352674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.353249] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be updated. [ 908.442077] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.443638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.443638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.443638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.443638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.453135] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: IN_PROGRESS for 2s [ 909.251549] env[65630]: INFO networking_nsxv3.common.synchronization [req-47f53a62-342a-4719-a226-0613b8501630 req-752ed019-a4dd-471b-b4ee-a2a2d3cebdc2 tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_members [ 909.252552] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_members [ 909.252552] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.252552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.252552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.253990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.253990] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.257072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.257254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.257585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.257734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.257916] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.388254] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: SUCCESS [ 909.388492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.389076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.389314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.389402] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.646786] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.646985] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.647129] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.647402] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.647662] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.647818] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.647940] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.648522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.649814] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.650107] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.650597] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.650597] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.650597] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.650722] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.650722] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.650865] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.673928] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.674120] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 909.674269] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.674444] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-199" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.674761] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-fe1bd403-435c-484b-9b67-607dddb1f8a9 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.674940] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.675072] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.675410] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.675547] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1bd403-435c-484b-9b67-607dddb1f8a9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.764904] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.765666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.765666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.765804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.765988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.766546] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.766763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.766763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.767326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.767326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.767433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044f1395-427c-4906-bf47-71c561e2457d already deleted. [ 909.767515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.894415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.894590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.089051] env[65630]: INFO networking_nsxv3.common.synchronization [req-a79926e2-8c5d-42aa-95f1-880b4fc084dc req-9996e56a-3a93-4dd4-97f5-041470898b44 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 910.089250] env[65630]: INFO networking_nsxv3.common.synchronization [req-a79926e2-8c5d-42aa-95f1-880b4fc084dc req-9996e56a-3a93-4dd4-97f5-041470898b44 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_members [ 910.089521] env[65630]: INFO networking_nsxv3.common.synchronization [req-a79926e2-8c5d-42aa-95f1-880b4fc084dc req-9996e56a-3a93-4dd4-97f5-041470898b44 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 910.090600] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 910.090716] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88d71553-69de-412d-9249-d3adff7aa4e7 with Priority: HIGHEST for action security_group_members [ 910.091072] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGHEST for action security_group_members [ 910.091306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.091403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.091639] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-88d71553-69de-412d-9249-d3adff7aa4e7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.091715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.091936] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.092028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.177917] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88d71553-69de-412d-9249-d3adff7aa4e7 in Status: SUCCESS [ 910.178315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.178948] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.179239] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.179354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.179644] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.179788] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.179944] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port fe1bd403-435c-484b-9b67-607dddb1f8a9 not found, creating... [ 910.180322] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.180513] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.180619] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.180904] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.181064] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.181424] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.181611] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.181753] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.181984] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.182328] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.182625] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: fe1bd403-435c-484b-9b67-607dddb1f8a9 is going to be created. [ 910.184283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.184421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.184606] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.184714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.184779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.184930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.185019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.185118] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.186858] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: SUCCESS [ 910.187039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.187813] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 910.187983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.188570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.188806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.188989] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.189124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.189486] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.189486] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.189486] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.189579] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.190412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.191471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.191711] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.191834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.191907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.192298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.192298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.192298] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.221593] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.221971] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.222254] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.222787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.222978] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.223260] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.457613] env[65630]: INFO networking_nsxv3.common.synchronization [req-15c3fb68-2eb6-4062-87d8-9daeedfb39fc req-3f800d13-26b5-43c5-97b1-e442f6f4e3b4 tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 910.461021] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 910.461021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.461021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.461021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.461021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.461021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.461021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.461021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.461021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.461021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.461021] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.475038] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: SUCCESS [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.475038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.475038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.475038] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.694662] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.694823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.694895] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.695175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.695247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.695437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.695540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.695602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.695758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.695834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.695922] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be updated. [ 910.697129] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.697250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.697316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.697475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.697553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.699577] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.699709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.699781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.699958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.700089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.700194] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88d71553-69de-412d-9249-d3adff7aa4e7 is going to be deleted. [ 910.701258] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.739821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.741462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.741462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.741462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.742485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.754552] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.754738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.754964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.755308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.755475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.755641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.755807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.756052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.756295] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.756421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.756515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.756733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.756847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.756983] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.759139] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: IN_PROGRESS for 2s [ 910.963407] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.981026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.981026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.981026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.981026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.981026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.981974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.981974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.981974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.981974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.981974] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.988691] env[65630]: INFO networking_nsxv3.common.synchronization [req-47f53a62-342a-4719-a226-0613b8501630 req-288849c6-169e-4583-b352-68b2e34261f1 service nova] Enqueued Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_rules [ 910.988881] env[65630]: INFO networking_nsxv3.common.synchronization [req-47f53a62-342a-4719-a226-0613b8501630 req-288849c6-169e-4583-b352-68b2e34261f1 service nova] Enqueued Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_members [ 910.990089] env[65630]: INFO networking_nsxv3.common.synchronization [req-47f53a62-342a-4719-a226-0613b8501630 req-288849c6-169e-4583-b352-68b2e34261f1 service nova] Enqueued Resource ID: fe1bd403-435c-484b-9b67-607dddb1f8a9 with Priority: HIGHEST for action port [ 910.991417] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_rules [ 910.991563] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_members [ 910.991660] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe1bd403-435c-484b-9b67-607dddb1f8a9 with Priority: HIGHEST for action port [ 910.997059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.997059] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.997059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.997059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.997059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.997059] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.997796] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe1bd403-435c-484b-9b67-607dddb1f8a9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.997796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.997796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.997796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.997929] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1bd403-435c-484b-9b67-607dddb1f8a9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.204117] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.260692] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.261784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.261784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.262419] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88d71553-69de-412d-9249-d3adff7aa4e7 already deleted. [ 911.262419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.262419] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.263023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.263264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.263423] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.263523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.263583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.263730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.263805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.263958] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.466988] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.485810] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00ac0e45-8fb0-4a0b-aeee-053765768653: rpc.has_security_group_logging(os_id): False [ 911.500186] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe1bd403-435c-484b-9b67-607dddb1f8a9 with status ACTIVE [ 911.500425] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.500565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.500636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.500855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.500950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.501176] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.501285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.501351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.501514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.501596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.501783] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.501881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.501942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.502192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.502277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.502369] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe1bd403-435c-484b-9b67-607dddb1f8a9 is going to be updated. [ 911.504495] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.505492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.505492] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.509036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.509473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.509473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.509473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.509473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.509662] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.509726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.509790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.509937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.510027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.510224] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.510322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.510382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.510523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.510605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.510799] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.510893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.510956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.511114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.511191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.511278] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be updated. [ 911.543021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.543174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.543270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.543567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.543718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.543876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe1bd403-435c-484b-9b67-607dddb1f8a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.605366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.605885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.605966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.606213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.606360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.634170] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: IN_PROGRESS for 2s [ 911.708375] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.708551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.708625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.708860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.708955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.709071] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 911.765437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.765643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.765643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.765981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.766645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.767552] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.767695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.767764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.767945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.768041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.768230] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.768330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.768392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.768541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.768618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.768767] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88d71553-69de-412d-9249-d3adff7aa4e7 already deleted. [ 911.768883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.769113] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88d71553-69de-412d-9249-d3adff7aa4e7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.796188] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 911.970076] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.970236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.970236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.970475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.970976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.970976] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 912.003062] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.003300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.003377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.003588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.003732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.006358] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.014152] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 912.271478] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88d71553-69de-412d-9249-d3adff7aa4e7: rpc.has_security_group_logging(os_id): False [ 912.293948] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.294809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.294809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.294809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.294809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.294809] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.294809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.295063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.295063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.295112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.295175] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88d71553-69de-412d-9249-d3adff7aa4e7 is going to be created. [ 912.337947] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/88d71553-69de-412d-9249-d3adff7aa4e7], does not exist path=[/infra/domains/default/groups/88d71553-69de-412d-9249-d3adff7aa4e7]."\n}' [ 912.338137] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88d71553-69de-412d-9249-d3adff7aa4e7 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/88d71553-69de-412d-9249-d3adff7aa4e7 [ 912.338209] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 912.469820] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.470245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.470245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.470551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.471866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.472274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.472468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.472548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.472823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.472955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.473310] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.473477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.473580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.473818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.473933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.474071] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88d71553-69de-412d-9249-d3adff7aa4e7 is going to be created. [ 912.508498] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.508680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.508753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.508977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.509086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.509189] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044f1395-427c-4906-bf47-71c561e2457d is going to be created. [ 912.515579] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/88d71553-69de-412d-9249-d3adff7aa4e7], does not exist path=[/infra/domains/default/groups/88d71553-69de-412d-9249-d3adff7aa4e7]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/88d71553-69de-412d-9249-d3adff7aa4e7 [ 912.515769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88d71553-69de-412d-9249-d3adff7aa4e7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.516057] env[65630]: Traceback (most recent call last): [ 912.516110] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 912.516110] env[65630]: return func(*args, **kwargs) [ 912.516110] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 912.516110] env[65630]: res.raise_for_status() [ 912.516110] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 912.516110] env[65630]: raise HTTPError(http_error_msg, response=self) [ 912.516110] env[65630]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/88d71553-69de-412d-9249-d3adff7aa4e7 [ 912.516110] env[65630]: During handling of the above exception, another exception occurred: [ 912.516110] env[65630]: Traceback (most recent call last): [ 912.516484] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 912.516484] env[65630]: listener.cb(fileno) [ 912.516484] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 912.516484] env[65630]: result = function(*args, **kwargs) [ 912.516484] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 912.516484] env[65630]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 912.516484] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 912.516484] env[65630]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 912.516484] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 912.516484] env[65630]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 912.516484] env[65630]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 912.516484] env[65630]: res.raise_for_status() [ 912.516484] env[65630]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 912.516484] env[65630]: raise HTTPError(http_error_msg, response=self) [ 912.516484] env[65630]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/88d71553-69de-412d-9249-d3adff7aa4e7 [ 912.516484] env[65630]: Removing descriptor: 62 [ 912.561519] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.561762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.561762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.561959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.562184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.585453] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044f1395-427c-4906-bf47-71c561e2457d in Status: UNINITIALIZED for 2s [ 912.775482] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: SUCCESS [ 912.775482] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 deletion is rescheduled due to dependency. [ 912.775482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.775482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.775694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.775823] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.775900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.776029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.776346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.776346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.776346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.776543] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.777582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.778874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.778874] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.778874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.778874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.778874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.778874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.778874] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.173279] env[65630]: INFO networking_nsxv3.common.synchronization [req-cda6d031-46a0-4215-b92c-b574591819b7 req-460c57b9-cc86-46bc-8f73-e77a2edc2072 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 913.173939] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 913.174456] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.174456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.174610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.174749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.174906] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.175017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.175088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.175398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.175504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.175604] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.282320] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.282885] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.282885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.282885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.283111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.309469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.309887] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.310063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.310131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.310422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.310574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.310725] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be updated. [ 913.353089] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.353089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.353089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.353089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.353089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.375916] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: IN_PROGRESS for 2s [ 913.546974] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.547301] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.547355] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.547605] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.547860] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.548028] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.548147] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.548357] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.548500] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.548711] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.548821] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.548931] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.549125] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.549174] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.549263] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.549433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.571171] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.571341] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.571475] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.571645] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.571956] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-8e808683-052a-425e-9899-6251275e2f46 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.572211] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.572336] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.572647] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.572784] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e808683-052a-425e-9899-6251275e2f46',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.648974] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: SUCCESS [ 913.649325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.678446] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.678637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.678686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.678882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.701047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.701047] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.701047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.701047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.701352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.701352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.701467] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 913.731323] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.731543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.731614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.731887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.732302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.744145] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 913.785879] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b6e41ae-02b7-4285-8dd1-1d78634488b5: rpc.has_security_group_logging(os_id): False [ 913.806163] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 913.806402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.806614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.806979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.807203] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.807342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.807408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.807576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.807659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.807748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.807916] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.807997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.808072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.808220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.808363] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.808460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.808522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.808658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.808734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.808817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.808904] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.810728] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.810842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.810910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.811092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.811182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.811635] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.811748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.811814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.811970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.812135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.812242] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be updated. [ 913.813362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.813528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.813685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.813789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.813854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.813999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.814094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.814187] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.880388] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.880593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.880626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.880845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.881008] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.897904] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: IN_PROGRESS for 2s [ 914.025137] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 914.025321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.075691] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.075922] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.076729] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.076729] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.076729] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.076844] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 8e808683-052a-425e-9899-6251275e2f46 not found, creating... [ 914.077064] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.077235] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.077353] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.077578] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.077715] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.078039] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.078200] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.078321] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.078528] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.078657] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.078794] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 8e808683-052a-425e-9899-6251275e2f46 is going to be created. [ 914.100503] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.100726] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.100849] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.101144] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.101371] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.101591] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.316311] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.317974] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a73db6d-e930-47a9-9dbe-748ef759f251: rpc.has_security_group_logging(os_id): False [ 914.346506] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.346506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.346506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.346673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.379837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.380174] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.380329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.380406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.380630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.380713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.380931] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.381103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.381180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.381364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.381530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.381650] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.381747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.381808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.381951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.382048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.382161] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 914.496279] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.496530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.496630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.497173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.497173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.530357] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 914.601829] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044f1395-427c-4906-bf47-71c561e2457d in Status: SUCCESS [ 914.602159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.602828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.602828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.602828] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.603122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.603205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.603594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.603594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.603594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.603720] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.819131] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.889257] env[65630]: INFO networking_nsxv3.common.synchronization [req-cda6d031-46a0-4215-b92c-b574591819b7 req-c76ec3cb-781b-44d8-826d-7c8ea1283d46 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 914.889393] env[65630]: INFO networking_nsxv3.common.synchronization [req-cda6d031-46a0-4215-b92c-b574591819b7 req-c76ec3cb-781b-44d8-826d-7c8ea1283d46 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 914.890032] env[65630]: INFO networking_nsxv3.common.synchronization [req-cda6d031-46a0-4215-b92c-b574591819b7 req-c76ec3cb-781b-44d8-826d-7c8ea1283d46 service nova] Enqueued Resource ID: 8e808683-052a-425e-9899-6251275e2f46 with Priority: HIGHEST for action port [ 914.890131] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 914.890390] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 914.890390] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e808683-052a-425e-9899-6251275e2f46 with Priority: HIGHEST for action port [ 914.891657] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.891657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.891657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.891657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.891657] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.893139] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.893139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.893393] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e808683-052a-425e-9899-6251275e2f46 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.893552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.893594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.893771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.893868] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e808683-052a-425e-9899-6251275e2f46',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.105534] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.321790] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.321904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.321979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.322918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.322918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.322918] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 915.388871] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.388961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.389026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.389439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.389439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.391494] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: SUCCESS [ 915.391494] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 deletion is rescheduled due to dependency. [ 915.391494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.396343] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e808683-052a-425e-9899-6251275e2f46 with status ACTIVE [ 915.396572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.397484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.397484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.397484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.397484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.397484] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.397484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.397960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.397960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.397960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.398119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.398231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.399033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.399033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.399033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.399033] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e808683-052a-425e-9899-6251275e2f46 is going to be updated. [ 915.400080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.401971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.401971] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 915.426885] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.426885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.426885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.426885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.426885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.426885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e808683-052a-425e-9899-6251275e2f46" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.608623] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 044f1395-427c-4906-bf47-71c561e2457d: rpc.has_security_group_logging(os_id): False [ 915.635700] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.635700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.635700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.635700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.635700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.636281] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.636432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.636640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.637927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.637927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.638050] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 044f1395-427c-4906-bf47-71c561e2457d is going to be created. [ 915.716082] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.716304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.716334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.716526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.716713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.730319] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 044f1395-427c-4906-bf47-71c561e2457d in Status: IN_PROGRESS for 2s [ 915.754056] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 915.754266] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 915.754561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.754789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.755024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.755213] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.755336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.755401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.755558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.755646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.755742] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.922758] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 in Status: SUCCESS [ 915.922980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.258233] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.551377] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 916.551618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.551941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.552209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.552297] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.760363] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.054268] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.054404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.263588] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.263825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.264152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.264255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.264328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.264450] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 917.298896] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.299048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.299104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.299304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.299468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.308782] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 917.367276] env[65630]: INFO networking_nsxv3.common.synchronization [req-dd745d29-a986-493a-9ae6-da6f5c113cde req-85c4c47f-a610-445e-9ca1-627a8bff0317 tempest-DeleteServersAdminTestJSON-1326035621 tempest-DeleteServersAdminTestJSON-1326035621-project-member] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 917.367856] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGHEST for action security_group_members [ 917.368195] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.368335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.368393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.368602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.368753] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.368848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.368903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.369502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.369626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.369626] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.416018] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 917.416018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.416401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.416611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.417738] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.417738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.417858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.417992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.418094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.418188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.418286] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.745880] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 044f1395-427c-4906-bf47-71c561e2457d in Status: SUCCESS [ 917.745880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.871824] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.872206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.872206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.872385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.893505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.893778] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.893909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.893971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.894196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.894281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.894372] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be updated. [ 917.923803] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.923979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.924067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.924272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.924461] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.924573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.924636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.924787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.924875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.924964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.925132] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.925224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.925290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.925423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.925575] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.925697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.925697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.925839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.925904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.925971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.926077] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.928422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.928578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.928578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.928752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.928881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.950034] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: IN_PROGRESS for 2s [ 918.429463] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a73db6d-e930-47a9-9dbe-748ef759f251: rpc.has_security_group_logging(os_id): False [ 918.449337] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.449492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.449563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.449812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.449951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.450213] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.450313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.450376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.450559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.450638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.450818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.450913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.450973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.451130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.451206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.451399] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.451493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.451554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.451714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.451788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.451872] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 918.573023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.573023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.573023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.573023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.573023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.601613] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 919.319604] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 919.320014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.320014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.320331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.320501] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.320624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.320687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.320851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.320932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.321071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.321128] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.823927] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.824121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.824201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.824448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.824694] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.824758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.824849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.825012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.825125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.825207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.825373] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.825469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.825530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.825682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.825826] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.825927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.825981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.826187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.826298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.826407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.826500] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.960372] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 in Status: SUCCESS [ 919.960578] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 deletion is rescheduled due to dependency. [ 919.960670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.331434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71bd905-a59a-420e-96dc-4f48e2b11e86: rpc.has_security_group_logging(os_id): False [ 920.356124] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.356124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.356124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.356124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.356124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.356124] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.356124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.356124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.356124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.356467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.356467] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.356576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.356576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.356686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.357357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.357357] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.357357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.357357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.357357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.357357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.357611] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 920.470377] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.470545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.470662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.470798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.470942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.492820] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 920.628972] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 920.629449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.201171] env[65630]: INFO networking_nsxv3.common.synchronization [req-affdd846-4ef8-451a-882f-0959b5d6f8ee req-f19bddbe-ec6c-4dc5-a8fe-ec745cd6499f tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 921.201171] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 921.201363] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.201519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.201574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.201834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.201999] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.202168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.202341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.202341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.202453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.202609] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.708218] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.708625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.708625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.708702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.744104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.744496] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.744603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.747112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.747112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.747112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.747112] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 921.783274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.787561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.787561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.787561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.787561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.801941] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 921.971843] env[65630]: INFO networking_nsxv3.common.synchronization [req-23eca0f1-3e71-4a36-80bd-ad6ad2da34ca req-046e5777-8632-41bf-a515-305717d3e8c6 tempest-MigrationsAdminTest-1222576144 tempest-MigrationsAdminTest-1222576144-project-member] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 921.971843] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 921.971967] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.972311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.972372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.972578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.972739] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.972837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.972898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.973401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.973401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.973401] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.330020] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-271 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.330020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.330020] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.330585] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.330882] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.331164] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.331285] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.331517] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.331654] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.331865] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.332531] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.332531] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.332531] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.332531] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.332531] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.332531] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.373601] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.373601] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.373601] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.373601] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-271" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.373601] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-453cc002-e521-4496-8dae-f5739014713c taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.373601] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.373601] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.373601] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.373601] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453cc002-e521-4496-8dae-f5739014713c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.475565] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.509485] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 922.509712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.876109] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.876109] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.876109] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.876499] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.876533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.876684] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 453cc002-e521-4496-8dae-f5739014713c not found, creating... [ 922.876946] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.877145] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.877283] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.877501] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.877636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.877915] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.878111] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.878239] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.878449] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.878623] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.878726] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 453cc002-e521-4496-8dae-f5739014713c is going to be created. [ 922.904118] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.904405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.904489] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.904854] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.905110] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.905374] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.978570] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.480846] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.480996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.481093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.481333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.481423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.481563] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 is going to be updated. [ 923.520300] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.520500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.520553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.520762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.520941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.534562] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: IN_PROGRESS for 2s [ 923.629584] env[65630]: INFO networking_nsxv3.common.synchronization [req-23eca0f1-3e71-4a36-80bd-ad6ad2da34ca req-f789a62b-6818-46ce-a0bf-6f7c52928c97 service nova] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_rules [ 923.629793] env[65630]: INFO networking_nsxv3.common.synchronization [req-23eca0f1-3e71-4a36-80bd-ad6ad2da34ca req-f789a62b-6818-46ce-a0bf-6f7c52928c97 service nova] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 923.629952] env[65630]: INFO networking_nsxv3.common.synchronization [req-23eca0f1-3e71-4a36-80bd-ad6ad2da34ca req-f789a62b-6818-46ce-a0bf-6f7c52928c97 service nova] Enqueued Resource ID: 453cc002-e521-4496-8dae-f5739014713c with Priority: HIGHEST for action port [ 923.630697] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_rules [ 923.630870] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 923.630967] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453cc002-e521-4496-8dae-f5739014713c with Priority: HIGHEST for action port [ 923.631407] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.631523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.631599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.631846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.631905] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.632903] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.633007] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.633250] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-453cc002-e521-4496-8dae-f5739014713c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.633360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.633419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.633601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.633680] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453cc002-e521-4496-8dae-f5739014713c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.813514] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 923.813696] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 923.813816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.135621] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.135960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.135960] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 453cc002-e521-4496-8dae-f5739014713c with status ACTIVE [ 924.136134] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.136245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.136312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.136540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.136631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.136806] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.136900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.136960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.137132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.137213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.137405] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.137499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.137559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.137697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.137771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.137856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 453cc002-e521-4496-8dae-f5739014713c is going to be updated. [ 924.160455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.160455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.160455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.160455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.160751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.160751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-453cc002-e521-4496-8dae-f5739014713c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.529186] env[65630]: INFO networking_nsxv3.common.synchronization [req-31a13a53-5130-487b-bef9-17595650b3c7 req-c2495100-53a9-41d3-80fc-f08c1a24ba08 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 924.529748] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 924.530077] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.530210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.530292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.530497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.531404] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.531404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.531404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.531404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.531404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.531404] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.901800] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.902029] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.902233] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.902534] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.902802] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.902963] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.903092] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.903391] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.903540] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.903748] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.903857] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.903964] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.904083] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.904191] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.904295] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.904485] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.926447] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.927392] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.927392] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.927392] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.927686] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-0abd5eb9-988e-46b3-9287-bbcdbdda0079 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.929754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.929754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.929754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.929754] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0abd5eb9-988e-46b3-9287-bbcdbdda0079',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.034133] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.431859] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.432248] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.433034] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.433034] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.433034] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.434352] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 0abd5eb9-988e-46b3-9287-bbcdbdda0079 not found, creating... [ 925.434484] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.434695] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.434850] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.435194] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.435427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.435762] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.435983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.436174] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.436419] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.436533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.437234] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 0abd5eb9-988e-46b3-9287-bbcdbdda0079 is going to be created. [ 925.474222] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.474525] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.474689] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.475021] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.475512] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.475512] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.536401] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.548073] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: SUCCESS [ 925.548073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.548313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.548521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.548701] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.548815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.548882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.549040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.549121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.549213] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.038868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.039079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.039079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.039315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.039495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.039598] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 926.054419] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.072906] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.073187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.073257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.073505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.073656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.085497] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 926.559146] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.630504] env[65630]: INFO networking_nsxv3.common.synchronization [req-31a13a53-5130-487b-bef9-17595650b3c7 req-4c07c655-85bf-451f-b05f-9513336b9072 service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 926.630732] env[65630]: INFO networking_nsxv3.common.synchronization [req-31a13a53-5130-487b-bef9-17595650b3c7 req-4c07c655-85bf-451f-b05f-9513336b9072 service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 926.630871] env[65630]: INFO networking_nsxv3.common.synchronization [req-31a13a53-5130-487b-bef9-17595650b3c7 req-4c07c655-85bf-451f-b05f-9513336b9072 service nova] Enqueued Resource ID: 0abd5eb9-988e-46b3-9287-bbcdbdda0079 with Priority: HIGHEST for action port [ 926.631473] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 926.631628] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 926.631709] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abd5eb9-988e-46b3-9287-bbcdbdda0079 with Priority: HIGHEST for action port [ 926.633566] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.633643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.633678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.633886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.634016] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.635048] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.635168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.635406] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0abd5eb9-988e-46b3-9287-bbcdbdda0079 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.635511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.635577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.635779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.635853] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0abd5eb9-988e-46b3-9287-bbcdbdda0079',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.064368] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.064546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.064634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.064911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.065047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.065180] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 is going to be updated. [ 927.108530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.108690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.108778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.108976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.109146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.119523] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: IN_PROGRESS for 2s [ 927.140184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.140331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.140520] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0abd5eb9-988e-46b3-9287-bbcdbdda0079 with status ACTIVE [ 927.140693] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.140836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.140890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.141275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.141330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.141503] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.141572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.141635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.141798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.141879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.142073] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.142237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.142310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.142461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.142548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.142635] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0abd5eb9-988e-46b3-9287-bbcdbdda0079 is going to be updated. [ 927.168239] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.168462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.168462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.169075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.169075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.169075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0abd5eb9-988e-46b3-9287-bbcdbdda0079" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.098180] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 928.098180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.098513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.098639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.098879] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.099072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.099165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.099389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.099769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.099769] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.603787] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.108880] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.132448] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: SUCCESS [ 929.132448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.132448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.132448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.132448] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.132962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.135376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.135376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.135376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.135376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.135376] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.611509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.611766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.611919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.612279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.612358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.612468] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 929.637978] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.638501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.638623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.638870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.639550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.639709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.639797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.640015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.640108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.640311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.640381] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.640467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.640527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.640677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.640820] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.640913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.640974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.641301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.641301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.641412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.641482] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.653422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.653587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.653664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.653903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.654076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.667734] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 930.144321] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c09c32-a206-4c5b-9a2a-99cacfd18ac7: rpc.has_security_group_logging(os_id): False [ 930.167415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.167574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.167634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.167854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.191646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.191911] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.192602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.192602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.192602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.192602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.192876] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.192876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.192876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.193065] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.193119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.193411] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.193717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.193717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.193948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.193948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.193948] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 is going to be updated. [ 930.261057] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.261273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.261273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.263394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.263394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.287458] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: IN_PROGRESS for 2s [ 931.268389] env[65630]: INFO networking_nsxv3.common.synchronization [req-e6153d2b-0e30-455e-9b05-8fa22f00747d req-14a7201b-7f83-40cf-a5b4-5e03d240cfae tempest-ListImageFiltersTestJSON-1975870512 tempest-ListImageFiltersTestJSON-1975870512-project-member] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 931.268768] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGHEST for action security_group_members [ 931.271911] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.271911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.271911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.271911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.271911] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.271911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.271911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.271911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.271911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.271911] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.671933] env[65630]: INFO networking_nsxv3.common.synchronization [req-d7dfa1fb-129f-4fca-89d9-d4b568a504d7 req-8631ce26-3e14-46d8-968c-2ffebac5f84c tempest-ServerRescueTestJSON-196804760 tempest-ServerRescueTestJSON-196804760-project-member] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 931.673212] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 931.673852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.674028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.674028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.674373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.674466] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.674584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.674650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.674808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.675016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.675746] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.684054] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 931.684319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.685476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.685977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.685977] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.685977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.685977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.686257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.686257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.687094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.687182] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.775793] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.775897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.775947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.776917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.801992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.802390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.802530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.802608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.802874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.802990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.803103] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be updated. [ 931.840929] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.841139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.841139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.841377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.841526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.852284] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: IN_PROGRESS for 2s [ 932.179047] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-276 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.179269] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.179396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.180329] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.180329] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.180592] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.180632] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.180987] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.181176] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.181404] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.181522] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.181768] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.181884] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.182011] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.182149] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.183358] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.183518] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.190130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.190303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.190370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.190589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.190854] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.190854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.190973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.191083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.191174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.191263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.191412] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.191549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.191584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.191904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.192079] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.192209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.192271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.192431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.192515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.192600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.193065] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.209363] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.209530] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.209687] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.209853] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-276" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.210251] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-f690d828-5ff4-44ea-abaf-48740f602452 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.210435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.210556] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.210881] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.211036] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f690d828-5ff4-44ea-abaf-48740f602452',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.310329] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: SUCCESS [ 932.310718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.497248] env[65630]: INFO networking_nsxv3.common.synchronization [req-b77e47a2-350c-434b-86d7-4d29b97495c0 req-1c9e7bfb-98be-41ed-9b49-6f2db3c737f9 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 932.498107] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 932.498615] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.500036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.500036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.500036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.500036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.500036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.500036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.500036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.500036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.500036] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.689729] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.695627] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d84857eb-b557-4aa2-8d62-34137b9cab1f: rpc.has_security_group_logging(os_id): False [ 932.713116] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.713492] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.713668] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.713999] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.714228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.714610] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port f690d828-5ff4-44ea-abaf-48740f602452 not found, creating... [ 932.715045] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.715185] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.715335] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.715676] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.715849] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.716181] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.716383] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.716511] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.716725] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.716857] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.717008] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: f690d828-5ff4-44ea-abaf-48740f602452 is going to be created. [ 932.718854] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.718976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.719059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.719218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.770737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.771463] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.771463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.771463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.771463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.771757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.771757] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.771870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.771935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.772159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.772258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.772463] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.772597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.772645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.772794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.772913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.772997] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 932.775896] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.776299] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.776527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.777484] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.777764] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.778089] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.867593] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.867926] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.868169] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.868577] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.869028] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.869315] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.869565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.869944] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.870326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.870639] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.870852] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.871031] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.871222] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.871358] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.871477] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.871700] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.895814] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.895989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.896045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.896260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.896406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.906630] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.906825] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.906933] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.907135] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.907503] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.907687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.907808] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.908202] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.908344] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3692ae6-3557-4c57-8bf4-0ea448c6ecba',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.953440] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 933.002356] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.002550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.002550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.002671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.002888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.003125] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.003237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.003319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.003497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.003577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.003679] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 already deleted. [ 933.003780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.192955] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.193156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.193156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.194089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.194089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.194089] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be updated. [ 933.239386] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.239524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.239599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.239961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.239961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.249433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: IN_PROGRESS for 2s [ 933.411551] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.412124] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.412124] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.412372] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.412957] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.412957] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port a3692ae6-3557-4c57-8bf4-0ea448c6ecba not found, creating... [ 933.413156] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.413302] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.413497] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.413815] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.413970] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.414368] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.414617] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.414808] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.415071] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.415216] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.415524] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: a3692ae6-3557-4c57-8bf4-0ea448c6ecba is going to be created. [ 933.438205] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.438429] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.438530] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.438837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.439048] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.439339] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.445746] env[65630]: INFO networking_nsxv3.common.synchronization [req-d7dfa1fb-129f-4fca-89d9-d4b568a504d7 req-49edcf8b-c25d-4984-8cee-1e464c4bed91 service nova] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_rules [ 933.445932] env[65630]: INFO networking_nsxv3.common.synchronization [req-d7dfa1fb-129f-4fca-89d9-d4b568a504d7 req-49edcf8b-c25d-4984-8cee-1e464c4bed91 service nova] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 933.446072] env[65630]: INFO networking_nsxv3.common.synchronization [req-d7dfa1fb-129f-4fca-89d9-d4b568a504d7 req-49edcf8b-c25d-4984-8cee-1e464c4bed91 service nova] Enqueued Resource ID: f690d828-5ff4-44ea-abaf-48740f602452 with Priority: HIGHEST for action port [ 933.446607] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_rules [ 933.446737] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 933.446832] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f690d828-5ff4-44ea-abaf-48740f602452 with Priority: HIGHEST for action port [ 933.447686] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.447824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.447892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.448143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.448199] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.449172] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.449172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.449347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f690d828-5ff4-44ea-abaf-48740f602452 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.449445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.449508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.449820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.449820] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f690d828-5ff4-44ea-abaf-48740f602452',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.868570] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 in Status: SUCCESS [ 933.869147] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 deletion is rescheduled due to dependency. [ 933.869147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.951162] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.951299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.951514] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f690d828-5ff4-44ea-abaf-48740f602452 with status ACTIVE [ 933.951708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.951820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.951887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.952137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.952284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.952465] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.952637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.952637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.952856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.952914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.953069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.953166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.953246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.953435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.953519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.953607] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f690d828-5ff4-44ea-abaf-48740f602452 is going to be updated. [ 933.980447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.980447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.980447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.980447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.980447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.980447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f690d828-5ff4-44ea-abaf-48740f602452" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.188314] env[65630]: INFO networking_nsxv3.common.synchronization [req-b77e47a2-350c-434b-86d7-4d29b97495c0 req-41f33ce1-b38e-4ccd-b653-475cfcfc36c8 service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 934.188314] env[65630]: INFO networking_nsxv3.common.synchronization [req-b77e47a2-350c-434b-86d7-4d29b97495c0 req-41f33ce1-b38e-4ccd-b653-475cfcfc36c8 service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 934.188314] env[65630]: INFO networking_nsxv3.common.synchronization [req-b77e47a2-350c-434b-86d7-4d29b97495c0 req-41f33ce1-b38e-4ccd-b653-475cfcfc36c8 service nova] Enqueued Resource ID: a3692ae6-3557-4c57-8bf4-0ea448c6ecba with Priority: HIGHEST for action port [ 934.188314] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 934.188314] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 934.188314] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3692ae6-3557-4c57-8bf4-0ea448c6ecba with Priority: HIGHEST for action port [ 934.188783] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.188916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.189309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.189309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.189397] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.190831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.190977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.191062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.191274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.191456] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.191558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.191632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.191798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.191886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.192771] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.193108] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.193108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.193108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.193269] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.193269] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3692ae6-3557-4c57-8bf4-0ea448c6ecba',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.695391] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.695734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.696045] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.697046] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3692ae6-3557-4c57-8bf4-0ea448c6ecba with status ACTIVE [ 934.697292] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.697448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.697530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.697757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.698235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.702759] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.702759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.702759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.702759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.702759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.702759] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.702759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.702759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.703639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.703639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.703639] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3692ae6-3557-4c57-8bf4-0ea448c6ecba is going to be updated. [ 934.728616] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.728616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.728616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.728616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.728616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.728616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3692ae6-3557-4c57-8bf4-0ea448c6ecba" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.969640] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 934.969640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.205913] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.261563] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: SUCCESS [ 935.261811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.261979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.262369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.262521] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.262713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.262819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.263090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.263207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.263358] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.708891] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.708891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.709245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.709245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.709740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.709740] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be created. [ 935.745262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.746443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.746527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.746975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.746975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.759611] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: UNINITIALIZED for 2s [ 935.766048] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.269365] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.772495] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.772495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.772495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.772950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.772950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.773072] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be updated. [ 936.806761] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.806850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.806972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.807294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.807478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.818702] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: IN_PROGRESS for 2s [ 937.772093] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 937.772336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.772573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.772940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.773346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.773439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.773681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.774708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.774972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.775059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.775540] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.278248] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.278480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.278593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.278947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.279206] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.279378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.279476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.279716] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.279882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.280079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.280449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.280560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.280631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.280788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.280947] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.281098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.281260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.281364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.281473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.281543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.281631] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.784304] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1: rpc.has_security_group_logging(os_id): False [ 938.803823] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.803957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.804066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.804282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.804372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.804601] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.804796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.804796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.805162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.805162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.805288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.805401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.805572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.805572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.805688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.805851] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.805947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.806014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.806520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.806520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.806520] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be created. [ 938.833696] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: SUCCESS [ 938.834029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.834217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.834451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.834854] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.835124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.835248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.835586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.835732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.835941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.838681] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.877219] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.877528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.877528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.877782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.878022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.893176] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 938.978561] env[65630]: INFO networking_nsxv3.common.synchronization [req-3160044b-6753-4f7e-b1c8-cd49f57d57e8 req-cf1c2e9e-974b-43ed-bc3b-a91e56e2e833 tempest-ListServerFiltersTestJSON-678265133 tempest-ListServerFiltersTestJSON-678265133-project-member] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 938.979738] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGHEST for action security_group_members [ 938.980184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.980341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.980413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.982139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.982139] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.982139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.982139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.982139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.982139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.982139] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.341536] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.341714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.341714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.342639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.342639] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.342639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.342639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.342639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.342639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.342956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.342956] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.343040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.343143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.343379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.343600] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.343769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.343878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.344100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.344395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.344395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.344395] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.486084] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.486084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.486214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.486349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.523734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.524102] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.524283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.524391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.524670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.524771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.524872] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be updated. [ 939.574144] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.574144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.574144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.574144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.574144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.589912] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: IN_PROGRESS for 2s [ 939.847494] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dbe819a-cf2f-494c-95fc-b507ea47e6d1: rpc.has_security_group_logging(os_id): False [ 939.870732] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.870910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.871041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.871347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.895142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.895390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.895513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.895585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.895839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.895923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.896129] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.896231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.896299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.896442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.896510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.896978] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.897093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.897150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.897307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.897399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.897489] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be updated. [ 939.969030] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.969030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.969030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.969030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.969348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.983164] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: IN_PROGRESS for 2s [ 940.541438] env[65630]: INFO networking_nsxv3.common.synchronization [None req-5b115758-cc3b-44f4-b5ea-bab12dfdbcb7 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_rules [ 940.542346] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_rules [ 940.542806] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.542979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.543093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.543591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.543591] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.696633] env[65630]: INFO networking_nsxv3.common.synchronization [None req-741d3fbb-1604-4e19-b99e-238b73aee151 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_rules [ 940.697296] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_rules [ 940.697603] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.698045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.904907] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 940.905294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.067017] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.067017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.067017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.067266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.067297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.068643] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f already deleted. [ 941.068643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.068643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.068643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.068643] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.249721] env[65630]: INFO networking_nsxv3.common.synchronization [req-cfab8dc7-5f93-451b-84dd-c659516044b8 req-67ca6b6e-5412-4c61-a0e3-c2a6666c8fc7 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 941.250363] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 941.250715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.251072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.251072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.253414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.253604] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.253727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.253791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.253987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.254093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.254191] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.605543] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.605779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.605822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.606325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.606325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.606325] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f already deleted. [ 941.606325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.607354] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c in Status: SUCCESS [ 941.607453] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c deletion is rescheduled due to dependency. [ 941.608449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.756837] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.001874] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: SUCCESS [ 942.002142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.208674] env[65630]: INFO networking_nsxv3.common.synchronization [req-31d12df4-a7c3-40b0-97b6-c3d29867e799 req-d7edb483-8243-40e8-896d-dea62076f44b tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 942.209240] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 942.209571] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.209693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.209760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.210018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.210706] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.210836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.210996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.211300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.211422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.211612] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.260034] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.552042] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.552042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.552042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.552042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.552042] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.552042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.552042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.552500] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.552744] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.553057] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.553295] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.553506] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.553701] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.553895] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.554125] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.554356] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.574744] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.575189] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.575431] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.575709] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.576145] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.576520] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.576749] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.577144] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.577414] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38eff44e-c0ad-442c-a27b-d0e9e7c89f5e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.716644] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.716644] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.716644] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d already deleted. [ 942.716644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.761799] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.761799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.761799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.761799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.762361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.762714] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 942.814867] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.815057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.815136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.815361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.815512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.829299] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 943.081683] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.081683] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.081683] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.082152] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.082152] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.082238] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 38eff44e-c0ad-442c-a27b-d0e9e7c89f5e not found, creating... [ 943.082941] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.082941] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.082941] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.083870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.083870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.083870] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.084030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.084096] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.084363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.084942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.084942] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 38eff44e-c0ad-442c-a27b-d0e9e7c89f5e is going to be created. [ 943.106876] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.107113] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.107242] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.107610] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.107759] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.107996] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.222806] env[65630]: INFO networking_nsxv3.common.synchronization [req-15cc27da-bf18-468c-a690-0452b64a4565 req-5e558a68-00d2-42e3-9535-7c9e9d7a8007 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 943.224013] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 943.224013] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.224013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.224234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.224234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.224417] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.224516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.224624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.224747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.224816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.224912] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.727703] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.727868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.727929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.728181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.728292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.728477] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.728592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.728664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.728786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.728863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.728953] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 943.766267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.766453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.766453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.767115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.767115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.780227] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 943.860260] env[65630]: INFO networking_nsxv3.common.synchronization [req-31d12df4-a7c3-40b0-97b6-c3d29867e799 req-0f62141f-f41c-4c4c-8bbb-422466e0ff04 service nova] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 943.860849] env[65630]: INFO networking_nsxv3.common.synchronization [req-31d12df4-a7c3-40b0-97b6-c3d29867e799 req-0f62141f-f41c-4c4c-8bbb-422466e0ff04 service nova] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 943.860849] env[65630]: INFO networking_nsxv3.common.synchronization [req-31d12df4-a7c3-40b0-97b6-c3d29867e799 req-0f62141f-f41c-4c4c-8bbb-422466e0ff04 service nova] Enqueued Resource ID: 38eff44e-c0ad-442c-a27b-d0e9e7c89f5e with Priority: HIGHEST for action port [ 943.861158] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 943.861294] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 943.861390] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38eff44e-c0ad-442c-a27b-d0e9e7c89f5e with Priority: HIGHEST for action port [ 943.861674] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.861807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.861901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.862153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.862201] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.863167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.863308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.863421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.864270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.864270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.864270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.864270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.864270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.864270] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.864270] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.865015] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.866050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.866102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.866256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.866323] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38eff44e-c0ad-442c-a27b-d0e9e7c89f5e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.369075] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.370301] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.370489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.370665] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38eff44e-c0ad-442c-a27b-d0e9e7c89f5e with status ACTIVE [ 944.370857] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.371086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.371086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.371492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.371492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.371647] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.371791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.371886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.372113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.372210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.372454] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.372584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.372668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.372845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.372925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.373032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38eff44e-c0ad-442c-a27b-d0e9e7c89f5e is going to be updated. [ 944.397445] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.397595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.397689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.397908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.398059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.398254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38eff44e-c0ad-442c-a27b-d0e9e7c89f5e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.869354] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 944.869609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.875410] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.377921] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.378231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.378231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.378464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.378629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.378777] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d is going to be created. [ 945.420496] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.420680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.420762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.420993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.421188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.451501] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: UNINITIALIZED for 2s [ 945.793260] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 945.793260] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 945.793260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.821247] env[65630]: INFO networking_nsxv3.common.synchronization [None req-2e84ec47-0d5b-4704-b8ca-0ed36c7c1ac3 tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_rules [ 945.821818] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_rules [ 945.822174] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.822362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.822420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.822709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.822874] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.073052] env[65630]: INFO networking_nsxv3.common.synchronization [None req-be81c51c-4028-44c3-8367-8047689a406f tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_rules [ 946.073677] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_rules [ 946.075236] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.075236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.348419] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.348555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.348873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.349157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.349242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.349848] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc already deleted. [ 946.349848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.350683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.350683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.350683] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.877198] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.877659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.877659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.877659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.877841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.877900] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc already deleted. [ 946.878114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.461693] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: SUCCESS [ 947.461921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.462117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.462390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.462606] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.462830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.462897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.463099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.463182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.463318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.463420] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.965950] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.132025] env[65630]: INFO networking_nsxv3.common.synchronization [req-4bc9089c-a997-40e2-867e-049374872bb8 req-3282f95f-258c-40b0-9bd1-0020cf83941b tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 948.133616] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 948.133616] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.133616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.133616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.133616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.133938] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.133938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.133938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.134043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.134154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.134347] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.470341] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 636d8397-05bf-4fff-8f28-4b4ded6b5b5d: rpc.has_security_group_logging(os_id): False [ 948.490130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.490130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.490130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.490624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.490863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.491493] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.491493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.491493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.491493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.491493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.491800] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d is going to be created. [ 948.605525] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.605723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.606232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.606232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.606345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.628500] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: IN_PROGRESS for 2s [ 948.637904] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.638080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.638158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.638366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.638455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.638656] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.638765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.638818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.638954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.639031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.639123] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 948.689353] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.689468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.689508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.689932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.689932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.711453] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 950.648022] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: SUCCESS [ 950.648022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.724278] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 950.724801] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 deletion is rescheduled due to dependency. [ 950.724801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.080442] env[65630]: INFO networking_nsxv3.common.synchronization [None req-014aad48-a2ed-4ca3-bae6-19e01bc173bc None None] Enqueued Resource ID: 9d982c7c-8530-454f-9b98-c4ba14e9b2a0 with Priority: HIGHEST for action port [ 951.080997] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d982c7c-8530-454f-9b98-c4ba14e9b2a0 with Priority: HIGHEST for action port [ 951.081460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d982c7c-8530-454f-9b98-c4ba14e9b2a0 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.081671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d982c7c-8530-454f-9b98-c4ba14e9b2a0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.081835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d982c7c-8530-454f-9b98-c4ba14e9b2a0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.082221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d982c7c-8530-454f-9b98-c4ba14e9b2a0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.082384] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d982c7c-8530-454f-9b98-c4ba14e9b2a0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.587083] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d982c7c-8530-454f-9b98-c4ba14e9b2a0 [ 951.587342] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.587482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.587544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.587765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.587887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.587987] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d982c7c-8530-454f-9b98-c4ba14e9b2a0 already deleted. [ 951.588084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d982c7c-8530-454f-9b98-c4ba14e9b2a0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.605128] env[65630]: INFO networking_nsxv3.common.synchronization [req-da8446de-0430-4c97-af22-9b0be6eb0cca req-29b9ac46-ee27-45c3-90db-06f4ea9acb0d tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_members [ 951.606025] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGHEST for action security_group_members [ 951.606805] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.606805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.606805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.607104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.607222] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.607436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.607500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.608110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.608110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.608110] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.111027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.111342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.111342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.111480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.132557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.132812] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.132936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.133011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.133277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.133382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.133520] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 is going to be updated. [ 952.164620] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.164783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.164840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.165071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.165210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.174660] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 in Status: IN_PROGRESS for 2s [ 952.336832] env[65630]: INFO networking_nsxv3.common.synchronization [None req-139ded7c-9006-48e6-9fb1-cb7515023f45 tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 952.337447] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 952.337818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.337965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.338040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.338410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.338410] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.447386] env[65630]: INFO networking_nsxv3.common.synchronization [None req-cf449f36-4cec-45ae-92c7-a41fa60ed17e tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 952.448350] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 952.448752] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.448975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.861105] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.861105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.861105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.861105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.861598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.861598] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe already deleted. [ 952.861598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.861598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.861709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.861761] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.377839] env[65630]: INFO networking_nsxv3.common.synchronization [None req-18a69409-4729-4e3f-ab7a-8d888dcb250a None None] Enqueued Resource ID: 075aece9-57c4-41af-87d4-5573f59dce69 with Priority: HIGHEST for action port [ 953.378419] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 075aece9-57c4-41af-87d4-5573f59dce69 with Priority: HIGHEST for action port [ 953.378737] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-075aece9-57c4-41af-87d4-5573f59dce69 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.378862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-075aece9-57c4-41af-87d4-5573f59dce69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.378930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-075aece9-57c4-41af-87d4-5573f59dce69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.379831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-075aece9-57c4-41af-87d4-5573f59dce69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.379932] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('075aece9-57c4-41af-87d4-5573f59dce69',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.385797] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.385939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.386072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.386678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.386678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.386678] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe already deleted. [ 953.386678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.449475] env[65630]: INFO networking_nsxv3.common.synchronization [req-74fea241-bbe7-424e-b45b-d8b7de2c715d req-4d2d1ada-9c25-415a-848b-997d0239774d tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 953.450092] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 953.450498] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.450682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.450759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.450962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.451136] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.451236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.451297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.451446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.451538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.451631] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.737190] env[65630]: INFO networking_nsxv3.common.synchronization [req-b65bd25e-4cf6-45e5-9985-d9ed33aac750 req-31570200-87fe-4105-a22c-60d3e935de4f tempest-ServersAdminTestJSON-797541960 tempest-ServersAdminTestJSON-797541960-project-member] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 953.738640] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGHEST for action security_group_members [ 953.738640] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.738640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.738640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.738858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.738858] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.738943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.738976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.739218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.739304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.739389] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.881693] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 075aece9-57c4-41af-87d4-5573f59dce69 [ 953.882078] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.882306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.882480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.882816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.883631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.883631] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:075aece9-57c4-41af-87d4-5573f59dce69 already deleted. [ 953.883631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-075aece9-57c4-41af-87d4-5573f59dce69" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.905289] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.905534] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.906122] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.909094] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.909094] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.909094] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.909094] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.909094] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.909308] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.912916] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.912916] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.912916] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.912916] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.912916] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.912916] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.912916] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.931584] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.931584] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.931584] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.931848] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-431" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.932088] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-c4abe94b-093c-420f-bebf-60d973ccb3d7 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.932434] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.932663] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.933168] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.933405] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4abe94b-093c-420f-bebf-60d973ccb3d7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.954609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.954609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.954609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.954801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.977388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.977600] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.977750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.977828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.981053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.981053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.981053] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be updated. [ 954.010507] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.010781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.010971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.011240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.011483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.024847] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 954.189047] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 in Status: SUCCESS [ 954.189240] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 deletion is rescheduled due to dependency. [ 954.189394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.243059] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.243228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.243323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.243916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.274798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.274798] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.274798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.274798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.274798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.274798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.274798] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be updated. [ 954.321326] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.321326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.321326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.321326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.321326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.330374] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: IN_PROGRESS for 2s [ 954.437158] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.437515] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.437611] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.437945] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.438138] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.438321] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port c4abe94b-093c-420f-bebf-60d973ccb3d7 not found, creating... [ 954.438640] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.438820] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.438961] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.439256] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.439419] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.439749] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.439938] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.440083] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.440368] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.440522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.440696] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: c4abe94b-093c-420f-bebf-60d973ccb3d7 is going to be created. [ 954.464363] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.464574] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.464717] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.465090] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.465265] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.465458] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.256637] env[65630]: INFO networking_nsxv3.common.synchronization [req-74fea241-bbe7-424e-b45b-d8b7de2c715d req-6a1040b6-e248-486b-9d86-fec1d7d43f0a service nova] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_rules [ 955.257016] env[65630]: INFO networking_nsxv3.common.synchronization [req-74fea241-bbe7-424e-b45b-d8b7de2c715d req-6a1040b6-e248-486b-9d86-fec1d7d43f0a service nova] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 955.257284] env[65630]: INFO networking_nsxv3.common.synchronization [req-74fea241-bbe7-424e-b45b-d8b7de2c715d req-6a1040b6-e248-486b-9d86-fec1d7d43f0a service nova] Enqueued Resource ID: c4abe94b-093c-420f-bebf-60d973ccb3d7 with Priority: HIGHEST for action port [ 955.257910] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_rules [ 955.258777] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 955.258777] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4abe94b-093c-420f-bebf-60d973ccb3d7 with Priority: HIGHEST for action port [ 955.258777] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.258777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.258777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.259078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.259078] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.262913] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.262913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.262913] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4abe94b-093c-420f-bebf-60d973ccb3d7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.262913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.262913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.262913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.262913] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4abe94b-093c-420f-bebf-60d973ccb3d7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.761387] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.761776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.763547] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4abe94b-093c-420f-bebf-60d973ccb3d7 with status ACTIVE [ 955.764253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.764546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.764618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.764950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.765052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.765884] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.766036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.766206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.766391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.766679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.766868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.767061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.767143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.767265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.767584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.767671] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4abe94b-093c-420f-bebf-60d973ccb3d7 is going to be updated. [ 955.790341] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.790503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.790592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.790793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.790925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.791107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4abe94b-093c-420f-bebf-60d973ccb3d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.034895] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 956.035132] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e deletion is rescheduled due to dependency. [ 956.035264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.035444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.035729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.035842] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.035978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.036046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.036197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.036284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.036378] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.341762] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 in Status: SUCCESS [ 956.341893] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 deletion is rescheduled due to dependency. [ 956.342016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.539153] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.041871] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.544767] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.544987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.544987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.546057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.546191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.546300] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be updated. [ 957.576706] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.576882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.577208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.577208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.577341] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.587359] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 958.843179] env[65630]: INFO networking_nsxv3.common.synchronization [req-66af9e6a-4e2c-4a48-b3d1-2f4f4c432844 req-92867e8d-c610-44f4-a52d-baced37daed6 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 958.843800] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 958.844241] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.844454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.844584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.844892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.845884] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.846077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.846182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.846406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.846580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.846694] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.258468] env[65630]: INFO networking_nsxv3.common.synchronization [req-bfdfca66-65e5-4330-95d0-13786a9cc4c9 req-0ed3011d-7b8f-4ebb-93fb-8311fc6ba7a3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 959.258863] env[65630]: INFO networking_nsxv3.common.synchronization [req-bfdfca66-65e5-4330-95d0-13786a9cc4c9 req-0ed3011d-7b8f-4ebb-93fb-8311fc6ba7a3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 959.258945] env[65630]: INFO networking_nsxv3.common.synchronization [req-bfdfca66-65e5-4330-95d0-13786a9cc4c9 req-0ed3011d-7b8f-4ebb-93fb-8311fc6ba7a3 tempest-SecurityGroupsTestJSON-90429897 tempest-SecurityGroupsTestJSON-90429897-project-member] Enqueued Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_members [ 959.259501] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGHEST for action security_group_members [ 959.259642] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGHEST for action security_group_members [ 959.259738] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e with Priority: HIGHEST for action security_group_members [ 959.260093] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.260217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.260282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.260519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.260685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.260782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.260844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.260997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.261100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.261196] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.262490] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.262669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.262759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.262927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.263535] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.263643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.263709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.263867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.263952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.264143] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.265132] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b25fb6e-f742-4dda-bb8b-ad33a402286e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.265263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.265332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.265695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.265695] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.265695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.265852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.267544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.267544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.267544] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b25fb6e-f742-4dda-bb8b-ad33a402286e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.332339] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.332645] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.332772] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.333072] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.333346] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.333528] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.333655] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.333875] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.334031] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.334246] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.334359] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.334467] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.334574] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.334739] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.334858] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.334994] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.350346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.350599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.350599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.350793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.350903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.351342] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.351342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.351553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.351601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.351664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.351760] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 959.360131] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.360302] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.360826] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.360826] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.361059] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.361310] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.361479] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.362047] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.362142] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.393821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.394028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.394109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.394371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.394535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.405829] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 959.600032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 959.601074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.601074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.601074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.601074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.602595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.602595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.602595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.602595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.602595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.602595] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.770038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.770445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.770721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.771984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.774055] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.774055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.774055] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.774742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.799381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.799381] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.799381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.799381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.799381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.799381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.799381] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be updated. [ 959.800971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.801425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.801625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.801972] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.802358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.802536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.802826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.803112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.803346] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be updated. [ 959.804464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.806456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.829781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.830055] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.830186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.830320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.830577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.830667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.830763] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e is going to be updated. [ 959.843023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.843023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.843023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.843023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.843023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.846293] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.846293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.846293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.846293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.846293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.859551] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: IN_PROGRESS for 2s [ 959.860316] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: IN_PROGRESS for 2s [ 959.864919] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.865226] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.865299] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.865576] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.865728] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.865878] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d not found, creating... [ 959.866187] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.866372] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.866459] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.866679] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.866815] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.867449] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.867573] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.867698] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.867920] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.868195] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.868434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d is going to be created. [ 959.878541] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.878671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.878736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.878936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.880498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.891019] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: IN_PROGRESS for 2s [ 959.892088] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.892289] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.892436] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.892722] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.892940] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.894702] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.104184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.104349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.104420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.104665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.104877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.104985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.105064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.105248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.105335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.105428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.105608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.105713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.105780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.105935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.106092] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.106186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.106248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.106388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.106466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.106545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.106630] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.609636] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0aff3db7-d7a7-4b84-8908-260cd4cfa00e: rpc.has_security_group_logging(os_id): False [ 960.628293] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.628505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.628546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.628768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.628868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.629066] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.629166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.629231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.629381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.629458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.629664] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.629759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.629863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.629959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.630043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.630220] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.630424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.630496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.630636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.630710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.630798] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be updated. [ 960.695179] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.695400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.695400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.695607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.695754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.710715] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 961.069449] env[65630]: INFO networking_nsxv3.common.synchronization [req-66af9e6a-4e2c-4a48-b3d1-2f4f4c432844 req-1add9a95-c146-4c09-97c4-d4b5cc0954d7 service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 961.069449] env[65630]: INFO networking_nsxv3.common.synchronization [req-66af9e6a-4e2c-4a48-b3d1-2f4f4c432844 req-1add9a95-c146-4c09-97c4-d4b5cc0954d7 service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 961.069449] env[65630]: INFO networking_nsxv3.common.synchronization [req-66af9e6a-4e2c-4a48-b3d1-2f4f4c432844 req-1add9a95-c146-4c09-97c4-d4b5cc0954d7 service nova] Enqueued Resource ID: 2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d with Priority: HIGHEST for action port [ 961.069449] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 961.069449] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 961.069449] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d with Priority: HIGHEST for action port [ 961.069449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.069449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.069449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.069449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.069449] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.070308] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.070429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.070638] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.070754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.070852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.071088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.071169] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.415625] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 961.415926] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 961.415926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.416457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.416457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.416864] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.417042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.417122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.417311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.417398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.417493] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.573069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.573257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.573600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d with status ACTIVE [ 961.573828] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.573944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.574106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.574236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.574325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.574530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.574657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.574718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.574901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.574972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.575162] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.575259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.575333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.575447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.575514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.575600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d is going to be updated. [ 961.600908] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.600908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.601140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.601280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.601423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.601670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d0c622c-6b8c-4898-bbc7-c1d532aa7a6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.873496] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 in Status: SUCCESS [ 961.874874] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 deletion is rescheduled due to dependency. [ 961.874874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.874874] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 in Status: SUCCESS [ 961.875142] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 deletion is rescheduled due to dependency. [ 961.875142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.903497] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e in Status: SUCCESS [ 961.903751] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b25fb6e-f742-4dda-bb8b-ad33a402286e deletion is rescheduled due to dependency. [ 961.903883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b25fb6e-f742-4dda-bb8b-ad33a402286e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.919413] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.423216] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.725789] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 962.726048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.926769] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.926769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.926769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.926957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.927702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.927702] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 962.959651] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.959799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.959868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.960091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.960233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.969488] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 963.891954] env[65630]: INFO networking_nsxv3.common.synchronization [req-00753648-301a-4c3a-b1e2-112b38fa5878 req-3a8dcf59-bcd1-4b18-87e3-de86af651e72 tempest-ServerRescueTestJSON-196804760 tempest-ServerRescueTestJSON-196804760-project-member] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 963.892576] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 963.892886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.893026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.893092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.893281] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.893447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.893557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.893618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.894753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.894854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.894956] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.397347] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.901000] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.997180] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 964.998329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.998329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.998329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.998329] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.998329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.998329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.998329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.998555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.998689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.998807] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.403581] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.403795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.403870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.404116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.404204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.404303] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be updated. [ 965.437222] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.437370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.437501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.437678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.437813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.450167] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: IN_PROGRESS for 2s [ 965.502572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.502765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.502851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.503115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.503235] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.503447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.503447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.503581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.503623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.503918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.503918] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.504047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.505123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.505123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.505123] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.505123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.505123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.505123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.505123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.505123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.505123] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.761356] env[65630]: INFO networking_nsxv3.common.synchronization [req-a02fe69e-fccf-4978-8d0b-9d2cc8f7048e req-2cb84645-58f5-4c86-86a3-73729e780c7f tempest-ImagesOneServerNegativeTestJSON-1185571522 tempest-ImagesOneServerNegativeTestJSON-1185571522-project-member] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 965.762293] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGHEST for action security_group_members [ 965.763317] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.763317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.763317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.763317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.763584] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.763584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.763584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.763780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.763913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.764044] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.009140] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14b62121-4e0b-44ce-9aab-8ed6b4024ea4: rpc.has_security_group_logging(os_id): False [ 966.031810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.031979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.032071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.032597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.032597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.032703] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.032772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.032808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.032947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.033032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.033231] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.033886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.033886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.033886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.033886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.033886] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.034122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.034122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.034122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.034213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.034272] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 966.108334] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.108334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.108334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.108334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.108334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.130747] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 966.266228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.266414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.266452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.266672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.266765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.267048] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.267213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.267213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.267369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.267445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.267533] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be updated. [ 966.298585] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.301068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.301068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.301068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.301068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.313303] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: IN_PROGRESS for 2s [ 967.463720] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: SUCCESS [ 967.464403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.685211] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e6546e0f-7d3a-40e7-a04a-65e78140bc40 None None] Enqueued Resource ID: d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b with Priority: HIGHEST for action port [ 967.685211] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b with Priority: HIGHEST for action port [ 967.685211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.685211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.686650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.686970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.687101] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.157074] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 968.157333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.189868] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b [ 968.190131] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.190268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.190350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.190587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.190682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.190779] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b already deleted. [ 968.190860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d40e5ec1-a9bb-4861-a0bf-8e6f4352e33b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.323905] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e in Status: SUCCESS [ 968.323905] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e deletion is rescheduled due to dependency. [ 968.323905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.632232] env[65630]: INFO networking_nsxv3.common.synchronization [None req-f57574ec-680c-4291-ae3e-57910081518b tempest-ServersTestJSON-234048922 tempest-ServersTestJSON-234048922-project-member] Enqueued Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_rules [ 968.633211] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_rules [ 968.634047] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.634047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.634047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.634445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.635405] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.784178] env[65630]: INFO networking_nsxv3.common.synchronization [None req-29556b79-8dc5-4ab5-afe7-0500f3ba3354 tempest-ServersTestJSON-234048922 tempest-ServersTestJSON-234048922-project-member] Enqueued Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_rules [ 968.784509] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_rules [ 968.784860] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.784981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.160292] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.160292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.160292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.160620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.160620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.160851] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 already deleted. [ 969.160851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.161057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.161245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.161332] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.684095] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.684494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.684494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.684607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.684607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.684797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 already deleted. [ 969.684797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.104054] env[65630]: INFO networking_nsxv3.common.synchronization [None req-aee78db9-996c-4e15-b1af-f97d8dd23d74 None None] Enqueued Resource ID: 7c5449bc-f8ed-4257-abce-68025d0d303a with Priority: HIGHEST for action port [ 970.108441] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5449bc-f8ed-4257-abce-68025d0d303a with Priority: HIGHEST for action port [ 970.108441] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c5449bc-f8ed-4257-abce-68025d0d303a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.108441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c5449bc-f8ed-4257-abce-68025d0d303a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.108441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c5449bc-f8ed-4257-abce-68025d0d303a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.108441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c5449bc-f8ed-4257-abce-68025d0d303a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.108441] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c5449bc-f8ed-4257-abce-68025d0d303a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.610742] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c5449bc-f8ed-4257-abce-68025d0d303a [ 970.610742] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.610742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.610742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.610742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.610742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.610742] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c5449bc-f8ed-4257-abce-68025d0d303a already deleted. [ 970.610742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c5449bc-f8ed-4257-abce-68025d0d303a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.750942] env[65630]: INFO networking_nsxv3.common.synchronization [req-3da549c9-2afb-4738-bb40-b449832586d0 req-b81bbed5-de21-4a99-9f91-77bc95e50310 tempest-ServerActionsV293TestJSON-1369746759 tempest-ServerActionsV293TestJSON-1369746759-project-member] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_members [ 971.756381] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGHEST for action security_group_members [ 971.756511] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.756581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.756611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.756848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.757021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.757446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.757508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.757690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.757837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.757885] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.260759] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.260937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.261102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.261520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.288808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.288808] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.288808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.288808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.288808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.288808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.288808] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c is going to be updated. [ 972.317636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.317808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.317894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.319896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.319896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.331627] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: IN_PROGRESS for 2s [ 974.343027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c in Status: SUCCESS [ 974.343027] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c deletion is rescheduled due to dependency. [ 974.343356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.737700] env[65630]: INFO networking_nsxv3.common.synchronization [req-cfab2e18-ed86-4e8c-90b2-c858f37c1495 req-2a23b9c2-3bcf-4380-a1ba-b8dfa0dfd83a tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 976.738420] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 976.738747] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.739088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.739158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.739367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.739567] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.739679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.739836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.740024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.740109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.740214] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.245146] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.245146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.245146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.245146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.267195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.269311] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.269832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.269941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.270213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.271081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.271081] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 977.305426] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.305426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.305426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.305426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.305426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.317924] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 978.491629] env[65630]: INFO networking_nsxv3.common.synchronization [req-b96b470b-7ee4-483f-8413-ca96369d2c49 req-5cae72eb-76cc-4760-a41e-7ee19363b4a9 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_members [ 978.492315] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_members [ 978.492709] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.492856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.492929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.493296] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.493846] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.493846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.493846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.494074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.494243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.494445] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.833772] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.834046] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.834141] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.834438] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.834727] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.834904] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.837383] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.837715] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.837901] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.838165] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.838295] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.838422] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.838536] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.838645] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.838753] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.839073] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.862643] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.862868] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.863064] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.864207] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.864617] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.864828] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.864968] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.865360] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.865580] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.997039] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.997039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.997039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.997039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.997039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.997407] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.997407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.997407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.997407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.997545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.997574] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f already deleted. [ 978.997683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.327342] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 979.327552] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 deletion is rescheduled due to dependency. [ 979.327676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.368193] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.368334] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.368441] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.368722] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.369098] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.369098] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a not found, creating... [ 979.369288] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.369439] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.369554] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.369771] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.369899] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.370195] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.370348] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.370461] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.370667] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.370794] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.370932] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a is going to be created. [ 979.392103] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.392332] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.392470] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.392816] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.393056] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.393302] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.111683] env[65630]: INFO networking_nsxv3.common.synchronization [req-b96b470b-7ee4-483f-8413-ca96369d2c49 req-47397a6b-7369-4cb3-8d8a-0f315152c2fb service nova] Enqueued Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_rules [ 980.111683] env[65630]: INFO networking_nsxv3.common.synchronization [req-b96b470b-7ee4-483f-8413-ca96369d2c49 req-47397a6b-7369-4cb3-8d8a-0f315152c2fb service nova] Enqueued Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_members [ 980.111683] env[65630]: INFO networking_nsxv3.common.synchronization [req-b96b470b-7ee4-483f-8413-ca96369d2c49 req-47397a6b-7369-4cb3-8d8a-0f315152c2fb service nova] Enqueued Resource ID: 55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a with Priority: HIGHEST for action port [ 980.112211] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_rules [ 980.112354] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_members [ 980.112452] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a with Priority: HIGHEST for action port [ 980.113336] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.113540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.113697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.113947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.114078] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.115290] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.115450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.115571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.115785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.115974] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.116116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.116210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.116372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.116481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.116590] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.117838] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.117987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.118087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.118263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.118363] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.620014] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.620167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.620366] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.621451] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a with status ACTIVE [ 980.621650] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.621843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.621913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.622149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.622259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.622465] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.622640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.622696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.622857] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.622937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.623155] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.623254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.623316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.623456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.623546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.623638] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a is going to be updated. [ 980.646249] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.646484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.646535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.646718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.646854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.647025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55f0f215-c1c8-44dd-8ef6-cf0eee29fb0a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.076182] env[65630]: INFO networking_nsxv3.common.synchronization [req-970a1b39-a578-4f75-8b2b-a4cb63ff88e0 req-5d7ef74b-c787-411c-8b9d-13c039c7a114 tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_members [ 981.076756] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_members [ 981.077086] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.077212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.077280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.077586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.077771] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.077883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.077964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.078116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.078201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.078322] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.125902] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.438226] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-124 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.438769] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.438769] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.439037] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.439100] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.439473] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.441244] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.441244] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.441244] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.441244] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.441244] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.441244] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.441244] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.441244] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.441244] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.441244] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.464218] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.466650] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.466650] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.466650] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-124" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.466650] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.466650] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.466650] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.466650] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.466650] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ed0c9f-1451-4895-abb9-6498c3a37b2c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.584358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.584358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.584358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.584358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.584358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.584358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.584358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.584358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.584963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.584963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.584963] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc already deleted. [ 981.584963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.629604] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.629806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.629878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.630125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.630183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.630299] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f is going to be created. [ 981.660926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.661139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.661204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.661419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.661584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.672732] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d95e012-be49-40d8-aebd-6518bae0677f in Status: UNINITIALIZED for 2s [ 981.969063] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.969369] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.969569] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.969956] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.970167] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.970353] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port a2ed0c9f-1451-4895-abb9-6498c3a37b2c not found, creating... [ 981.970760] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.970978] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.971164] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.971356] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.971546] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.971891] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.972141] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.972951] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.972951] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.972951] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.972951] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: a2ed0c9f-1451-4895-abb9-6498c3a37b2c is going to be created. [ 981.995388] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.995690] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.995871] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.996373] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.996373] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.996639] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.702721] env[65630]: INFO networking_nsxv3.common.synchronization [req-970a1b39-a578-4f75-8b2b-a4cb63ff88e0 req-bf625bb7-9ff8-433a-85b3-a1d9bd90f16a service nova] Enqueued Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_rules [ 982.703122] env[65630]: INFO networking_nsxv3.common.synchronization [req-970a1b39-a578-4f75-8b2b-a4cb63ff88e0 req-bf625bb7-9ff8-433a-85b3-a1d9bd90f16a service nova] Enqueued Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_members [ 982.703122] env[65630]: INFO networking_nsxv3.common.synchronization [req-970a1b39-a578-4f75-8b2b-a4cb63ff88e0 req-bf625bb7-9ff8-433a-85b3-a1d9bd90f16a service nova] Enqueued Resource ID: a2ed0c9f-1451-4895-abb9-6498c3a37b2c with Priority: HIGHEST for action port [ 982.703729] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_rules [ 982.703881] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_members [ 982.704012] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ed0c9f-1451-4895-abb9-6498c3a37b2c with Priority: HIGHEST for action port [ 982.706394] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.706394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.706394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.706589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.706669] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.712402] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.712636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.712773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.712984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.713172] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.713277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.713333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.715049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.715049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.715049] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.715049] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.715049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.715049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.715049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.715049] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ed0c9f-1451-4895-abb9-6498c3a37b2c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.213015] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.213423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.216850] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.217884] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2ed0c9f-1451-4895-abb9-6498c3a37b2c with status ACTIVE [ 983.218115] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.218250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.218319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.218560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.218665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.219479] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.219479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.219479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.219479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.219479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.219479] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.219746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.219746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.219803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.219895] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.220484] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2ed0c9f-1451-4895-abb9-6498c3a37b2c is going to be updated. [ 983.242023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.242191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.242272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.242473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.242662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.242830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ed0c9f-1451-4895-abb9-6498c3a37b2c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.683381] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d95e012-be49-40d8-aebd-6518bae0677f in Status: SUCCESS [ 983.683707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.683891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.684150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.684360] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.684474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.684537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.684692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.684787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.684873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.684963] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.721698] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.187086] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.226532] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.226706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.226771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.226998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.227105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.227235] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc is going to be created. [ 984.253928] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.253928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.253928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.253928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.253928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.264442] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02aca142-9077-46f6-b85d-5cad6c950dcc in Status: UNINITIALIZED for 2s [ 984.689254] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d95e012-be49-40d8-aebd-6518bae0677f: rpc.has_security_group_logging(os_id): False [ 984.715062] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.715062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.715062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.715062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.715062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.715403] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.715403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.715504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.715650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.715707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.715784] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f is going to be created. [ 984.776475] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.776898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.776898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.777052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.777272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.792017] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d95e012-be49-40d8-aebd-6518bae0677f in Status: IN_PROGRESS for 2s [ 986.158665] env[65630]: INFO networking_nsxv3.common.synchronization [None req-0953ff66-a9c8-4721-a19c-f3204be5c8b3 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_rules [ 986.159294] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_rules [ 986.160033] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-260959d6-44de-432d-a8ee-ce634ff440ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.160033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.160033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.160265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.160341] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.246056] env[65630]: INFO networking_nsxv3.common.synchronization [None req-a7c731cd-c8a9-4d6b-bcb5-2c0739a2d50d tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_rules [ 986.246550] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_rules [ 986.246854] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-260959d6-44de-432d-a8ee-ce634ff440ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.246960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.275840] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02aca142-9077-46f6-b85d-5cad6c950dcc in Status: UNINITIALIZED for 4s [ 986.695428] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.695683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.695760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.695987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.696099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.696219] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 260959d6-44de-432d-a8ee-ce634ff440ed already deleted. [ 986.696310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.696490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.696752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.696950] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.806762] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d95e012-be49-40d8-aebd-6518bae0677f in Status: SUCCESS [ 986.807119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.219958] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.220362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.220362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.220444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.220480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.220576] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 260959d6-44de-432d-a8ee-ce634ff440ed already deleted. [ 987.220684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.288150] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02aca142-9077-46f6-b85d-5cad6c950dcc in Status: SUCCESS [ 988.288460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.288660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.288936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.289201] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.289359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.289454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.289651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.289768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.289961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.290107] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.794311] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.296611] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02aca142-9077-46f6-b85d-5cad6c950dcc: rpc.has_security_group_logging(os_id): False [ 989.376615] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.376784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.376847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.379204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.379204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.379204] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.379204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.380991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.382325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.382325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.382325] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc is going to be created. [ 989.461515] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.461665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.461726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.462123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.462123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.475171] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02aca142-9077-46f6-b85d-5cad6c950dcc in Status: IN_PROGRESS for 2s [ 990.356599] env[65630]: INFO networking_nsxv3.common.synchronization [req-967c2b11-20cc-4be9-92e5-053be7b2b0f5 req-f81cd0df-d7f7-4251-b6bd-d9931a20757d tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 990.357137] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 990.357607] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.358031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.358031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.358099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.358365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.358365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.358365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.358537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.358537] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.866062] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.866062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.866062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.866312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.866429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.866688] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.866834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.866924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.867119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.867237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.867338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe already deleted. [ 990.867435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.962016] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-50 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.962228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-50" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.962361] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-50" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.962747] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-50" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.963197] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.963358] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.963513] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.963726] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.963972] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.964103] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.964220] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.964332] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.964438] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.964549] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.964649] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.964787] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.986993] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.987213] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.987359] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.987555] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-50" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.988056] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-6b37434d-91d8-4a57-939e-109b22cf8c67 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.988744] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.988897] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.989420] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.989535] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37434d-91d8-4a57-939e-109b22cf8c67',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.488419] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02aca142-9077-46f6-b85d-5cad6c950dcc in Status: SUCCESS [ 991.488943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.492397] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.492625] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.492783] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.493103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.493256] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.493409] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 6b37434d-91d8-4a57-939e-109b22cf8c67 not found, creating... [ 991.493751] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.493853] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.493965] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.494224] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.494364] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.494762] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.494847] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.494908] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.495135] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.495268] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.495427] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 is going to be created. [ 991.517561] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.517848] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.517978] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.518273] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.518505] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.518783] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.251964] env[65630]: INFO networking_nsxv3.common.synchronization [req-967c2b11-20cc-4be9-92e5-053be7b2b0f5 req-9e66c51d-39b8-42de-8eb8-07d5a3bc071c service nova] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 992.252161] env[65630]: INFO networking_nsxv3.common.synchronization [req-967c2b11-20cc-4be9-92e5-053be7b2b0f5 req-9e66c51d-39b8-42de-8eb8-07d5a3bc071c service nova] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 992.252301] env[65630]: INFO networking_nsxv3.common.synchronization [req-967c2b11-20cc-4be9-92e5-053be7b2b0f5 req-9e66c51d-39b8-42de-8eb8-07d5a3bc071c service nova] Enqueued Resource ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 with Priority: HIGHEST for action port [ 992.252858] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 992.252990] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 992.253100] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 with Priority: HIGHEST for action port [ 992.253372] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.253492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.253558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.253771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.253858] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.254704] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.254848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.254848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.255648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.255648] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.255648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.255648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.255648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.255648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.255648] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.256617] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b37434d-91d8-4a57-939e-109b22cf8c67 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.256719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.256799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.256929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.257007] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37434d-91d8-4a57-939e-109b22cf8c67',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.761616] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.762767] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.762909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.766661] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b37434d-91d8-4a57-939e-109b22cf8c67 with status ACTIVE [ 992.766748] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.766855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.767073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.767141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.768027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.768027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.768027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.768194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.768293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.768387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.768618] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.768676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.768742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.768894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.768970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.769075] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 is going to be updated. [ 992.795652] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.795748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.795748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.795958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.796113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.796298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.271598] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.777193] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.777193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.777819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.777819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.777819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.777819] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be created. [ 993.802704] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.802873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.802948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.803273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.803384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.814138] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: UNINITIALIZED for 2s [ 994.329467] env[65630]: INFO networking_nsxv3.common.synchronization [None req-663fdee6-27f3-4ade-b62c-1f4d07866541 None None] Enqueued Resource ID: 1a4b81f3-432c-4e81-ad57-0041ecb14c72 with Priority: HIGHEST for action port [ 994.330484] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a4b81f3-432c-4e81-ad57-0041ecb14c72 with Priority: HIGHEST for action port [ 994.330818] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a4b81f3-432c-4e81-ad57-0041ecb14c72 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.330946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a4b81f3-432c-4e81-ad57-0041ecb14c72" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.331030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a4b81f3-432c-4e81-ad57-0041ecb14c72" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.332639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a4b81f3-432c-4e81-ad57-0041ecb14c72" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.333578] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a4b81f3-432c-4e81-ad57-0041ecb14c72',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.835549] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a4b81f3-432c-4e81-ad57-0041ecb14c72 [ 994.835839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.835839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.835962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.836657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.836821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.836962] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a4b81f3-432c-4e81-ad57-0041ecb14c72 already deleted. [ 994.837420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a4b81f3-432c-4e81-ad57-0041ecb14c72" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.828970] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 995.830572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.830985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.831747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.832221] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.832722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.832809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.833810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.833810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.833810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.833810] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.337899] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.842401] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f69e9012-529a-49ae-80ce-87883c1f49fe: rpc.has_security_group_logging(os_id): False [ 996.866214] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.866392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.866450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.866655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.866750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.867503] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.867503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.867503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.867503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.867503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.867503] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be created. [ 996.939339] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.939339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.939339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.939339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.939339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.956103] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 997.004288] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e866825a-78b2-4d50-bc1d-f24318e6e67f None None] Enqueued Resource ID: 56ce44a4-4319-49fa-a999-e65ad08874b3 with Priority: HIGHEST for action port [ 997.004867] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ce44a4-4319-49fa-a999-e65ad08874b3 with Priority: HIGHEST for action port [ 997.005229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-56ce44a4-4319-49fa-a999-e65ad08874b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.005358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56ce44a4-4319-49fa-a999-e65ad08874b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.005425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56ce44a4-4319-49fa-a999-e65ad08874b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.005684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56ce44a4-4319-49fa-a999-e65ad08874b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.005840] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56ce44a4-4319-49fa-a999-e65ad08874b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.509546] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56ce44a4-4319-49fa-a999-e65ad08874b3 [ 997.509890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.510051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.510115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.510336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.510415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.510514] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56ce44a4-4319-49fa-a999-e65ad08874b3 already deleted. [ 997.510575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56ce44a4-4319-49fa-a999-e65ad08874b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.975397] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 998.975397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.922163] env[65630]: INFO networking_nsxv3.common.synchronization [req-f0c0e490-7928-41f0-98fc-b49245a23b1a req-38575280-c862-422b-bae3-4fb296bc153a tempest-ServerRescueTestJSON-196804760 tempest-ServerRescueTestJSON-196804760-project-member] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 999.922163] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGHEST for action security_group_members [ 999.922163] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.922163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.922163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.922163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.922163] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.922544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.922740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.922994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.923190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.923366] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.426179] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.426506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.426506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.426642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.426738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.426974] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.427091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.427153] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.427333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.427440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.427555] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be updated. [ 1000.475336] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.475497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.475551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.475777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.475924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.486536] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: IN_PROGRESS for 2s [ 1002.497662] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 in Status: SUCCESS [ 1002.497913] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 deletion is rescheduled due to dependency. [ 1002.497952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.922059] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1004.922369] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1009.575029] env[65630]: INFO networking_nsxv3.common.synchronization [None req-732cf11a-7486-48c7-8d1d-1fd0bb9b6f99 None None] Enqueued Resource ID: d5c300bb-6243-4a76-87be-463dd757a7d1 with Priority: HIGHEST for action port [ 1009.575029] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5c300bb-6243-4a76-87be-463dd757a7d1 with Priority: HIGHEST for action port [ 1009.575029] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5c300bb-6243-4a76-87be-463dd757a7d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.575029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5c300bb-6243-4a76-87be-463dd757a7d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.575029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5c300bb-6243-4a76-87be-463dd757a7d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.576014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5c300bb-6243-4a76-87be-463dd757a7d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.576333] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5c300bb-6243-4a76-87be-463dd757a7d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.079666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5c300bb-6243-4a76-87be-463dd757a7d1 [ 1010.080075] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.080396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.080554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.081082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.081403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.081574] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5c300bb-6243-4a76-87be-463dd757a7d1 already deleted. [ 1010.081742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5c300bb-6243-4a76-87be-463dd757a7d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.187092] env[65630]: INFO networking_nsxv3.common.synchronization [req-c2454724-d770-4ad1-9cec-fbbe816dbd89 req-682eaabd-3545-47df-acd0-d50a854e5ba5 tempest-ServersTestJSON-234048922 tempest-ServersTestJSON-234048922-project-member] Enqueued Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_members [ 1010.187653] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_members [ 1010.187984] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.188150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.188196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.188418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.188571] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.188662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.188719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.188861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.188957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.189072] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.598820] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9900cd83-2e29-402f-a011-afd47ab23af5 tempest-ServersTestManualDisk-1045302247 tempest-ServersTestManualDisk-1045302247-project-member] Enqueued Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_rules [ 1010.599503] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_rules [ 1010.599835] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24ebd7ab-0776-4822-9b99-4e4b98571494 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.600070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.601146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.601454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.601905] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.627138] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.627138] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-407" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.627287] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-407" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.627800] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-407" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.628122] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.630659] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.630659] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.630659] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.631092] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.631253] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.631368] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.631664] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.631664] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.631815] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.631865] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.631995] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.659500] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.659500] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1010.659500] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.659500] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-407" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.659500] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-582aa783-ca9e-40d4-86ec-507dbd6f365e taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.659500] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.659829] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.660318] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.660318] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('582aa783-ca9e-40d4-86ec-507dbd6f365e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.691041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.691257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.691257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.691455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.691552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.691776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.691883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.692086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.692146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.692231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.692288] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 already deleted. [ 1010.692365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.752501] env[65630]: INFO networking_nsxv3.common.synchronization [None req-187e5aea-2047-4410-a316-41e1606a61bf tempest-ServersTestManualDisk-1045302247 tempest-ServersTestManualDisk-1045302247-project-member] Enqueued Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_rules [ 1010.753140] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_rules [ 1010.753554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24ebd7ab-0776-4822-9b99-4e4b98571494 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.753554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.131656] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.131656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.131656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.131656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.132111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.132111] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 already deleted. [ 1011.132111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.132111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.132479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.132479] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.166648] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.166879] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.167016] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.167363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.167572] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.167753] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 582aa783-ca9e-40d4-86ec-507dbd6f365e not found, creating... [ 1011.168015] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.168184] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.168300] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.168529] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.168769] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.168944] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.169139] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.169287] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.169537] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.169719] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.170323] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 582aa783-ca9e-40d4-86ec-507dbd6f365e is going to be created. [ 1011.195114] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.195114] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.195114] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.195114] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.195114] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.195428] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.655074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.656523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.656523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.656523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.656523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.656523] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 already deleted. [ 1011.656523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.949449] env[65630]: INFO networking_nsxv3.common.synchronization [req-c2454724-d770-4ad1-9cec-fbbe816dbd89 req-25908205-a44c-4ab3-b55b-ad494c43a3f6 service nova] Enqueued Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_rules [ 1011.949812] env[65630]: INFO networking_nsxv3.common.synchronization [req-c2454724-d770-4ad1-9cec-fbbe816dbd89 req-25908205-a44c-4ab3-b55b-ad494c43a3f6 service nova] Enqueued Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_members [ 1011.949812] env[65630]: INFO networking_nsxv3.common.synchronization [req-c2454724-d770-4ad1-9cec-fbbe816dbd89 req-25908205-a44c-4ab3-b55b-ad494c43a3f6 service nova] Enqueued Resource ID: 582aa783-ca9e-40d4-86ec-507dbd6f365e with Priority: HIGHEST for action port [ 1011.950801] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_rules [ 1011.950801] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_members [ 1011.950938] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 582aa783-ca9e-40d4-86ec-507dbd6f365e with Priority: HIGHEST for action port [ 1011.955175] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.955381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.955381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.955615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.955698] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.957735] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.957882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.957928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.958144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.958305] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.959302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.959302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.959302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.959302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.959302] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.960094] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-582aa783-ca9e-40d4-86ec-507dbd6f365e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.960195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.960195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.960549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.960549] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('582aa783-ca9e-40d4-86ec-507dbd6f365e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.095075] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9f6eba12-a49f-4ace-ad57-d3292df3e099 None None] Enqueued Resource ID: 43d59f26-a834-433c-8cbb-d2b05b891192 with Priority: HIGHEST for action port [ 1012.095350] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d59f26-a834-433c-8cbb-d2b05b891192 with Priority: HIGHEST for action port [ 1012.097348] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-43d59f26-a834-433c-8cbb-d2b05b891192 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.097476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43d59f26-a834-433c-8cbb-d2b05b891192" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.097543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43d59f26-a834-433c-8cbb-d2b05b891192" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.097802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43d59f26-a834-433c-8cbb-d2b05b891192" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.097883] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43d59f26-a834-433c-8cbb-d2b05b891192',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.462208] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.462371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.462619] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.463516] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 582aa783-ca9e-40d4-86ec-507dbd6f365e with status ACTIVE [ 1012.464313] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.464313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.464313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.464313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.464313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.464558] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.464558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.464558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.464658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.464722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.464905] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.464998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.465099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.465240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.465315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.465412] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 582aa783-ca9e-40d4-86ec-507dbd6f365e is going to be updated. [ 1012.487322] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.487476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.487553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.488259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.488439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.488985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-582aa783-ca9e-40d4-86ec-507dbd6f365e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.600073] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43d59f26-a834-433c-8cbb-d2b05b891192 [ 1012.600405] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.600549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.600624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.600846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.600944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.601061] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43d59f26-a834-433c-8cbb-d2b05b891192 already deleted. [ 1012.601113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43d59f26-a834-433c-8cbb-d2b05b891192" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.752135] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2443ab9-f80f-4006-a3d7-8f57e7d1c2c0 req-1e24e84f-0865-4c61-b498-eefe393da232 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1012.752519] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1012.752897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.753049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.753116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.753324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.753620] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.753620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.753620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.753872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.753872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.753941] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.967917] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.126163] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.126456] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.126817] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.126884] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.127414] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.127580] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.127697] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.127914] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.128074] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.128284] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.128644] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.128762] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.128875] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.128986] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.129104] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.129237] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.148480] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.148647] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.148778] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.148946] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.149270] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-cd8a13d3-344d-4885-a04e-98d260be70ad taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.149504] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.149624] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.149933] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.150424] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd8a13d3-344d-4885-a04e-98d260be70ad',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.256524] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.473926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.473926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.473926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.473926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.473926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.473926] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 is going to be created. [ 1013.501011] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.501011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.501011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.501011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.501011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.509249] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 in Status: UNINITIALIZED for 2s [ 1013.653314] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.654338] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.654338] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.654688] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.654947] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.655223] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port cd8a13d3-344d-4885-a04e-98d260be70ad not found, creating... [ 1013.655650] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.655872] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.656010] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.656340] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.656519] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.656998] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.657106] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.657231] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.657479] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.657645] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.657812] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: cd8a13d3-344d-4885-a04e-98d260be70ad is going to be created. [ 1013.681229] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.681484] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.681723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.682091] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.682328] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.682546] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.758733] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.261653] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.261826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.261899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.262527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.262527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.262527] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1014.292161] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.292343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.292477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.292612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.293188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.303755] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1014.406461] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2443ab9-f80f-4006-a3d7-8f57e7d1c2c0 req-41f173e2-d83c-46fc-9801-7955d2f29962 service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1014.406669] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2443ab9-f80f-4006-a3d7-8f57e7d1c2c0 req-41f173e2-d83c-46fc-9801-7955d2f29962 service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1014.406807] env[65630]: INFO networking_nsxv3.common.synchronization [req-b2443ab9-f80f-4006-a3d7-8f57e7d1c2c0 req-41f173e2-d83c-46fc-9801-7955d2f29962 service nova] Enqueued Resource ID: cd8a13d3-344d-4885-a04e-98d260be70ad with Priority: HIGHEST for action port [ 1014.407363] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1014.407498] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1014.407595] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8a13d3-344d-4885-a04e-98d260be70ad with Priority: HIGHEST for action port [ 1014.407870] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.407982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.408215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.408433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.408519] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.409811] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.409911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.410192] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd8a13d3-344d-4885-a04e-98d260be70ad taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.410332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.410398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.410575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.410648] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd8a13d3-344d-4885-a04e-98d260be70ad',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.911374] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.911697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.914018] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd8a13d3-344d-4885-a04e-98d260be70ad with status ACTIVE [ 1014.914278] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.914439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.914534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.914783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.914909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.915199] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.915308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.915369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.915524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.915601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.915785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.915880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.915939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.916090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.916163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.916247] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd8a13d3-344d-4885-a04e-98d260be70ad is going to be updated. [ 1014.941724] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.941891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.942080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.942502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.942681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.942985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd8a13d3-344d-4885-a04e-98d260be70ad" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.522661] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 in Status: SUCCESS [ 1015.522918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.523283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.523358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.523637] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.523637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.523863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.523863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.524332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.524332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.524332] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.027793] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.313832] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1016.314048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.314264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.314532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.314743] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.314888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.314964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.315197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.315276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.315379] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.530241] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 606afe18-cfb7-4b98-9fd4-530a5517abc9: rpc.has_security_group_logging(os_id): False [ 1016.551195] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.551370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.551370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.551620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.551727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.551997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.552128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.552214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.552403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.552505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.552627] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 is going to be created. [ 1016.652017] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.652242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.652342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.652656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.652919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.666406] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 in Status: IN_PROGRESS for 2s [ 1016.819209] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.323186] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.825704] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.825901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.825901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.826139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.826231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.826333] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1017.854225] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.854426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.854426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.854625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.854765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.865045] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1018.679707] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 in Status: SUCCESS [ 1018.680218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.408764] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1019.408764] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1019.876318] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1019.876670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.876861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.877261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.878105] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.878105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.878105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.878105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.878105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.878368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.878485] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.323932] env[65630]: INFO networking_nsxv3.common.synchronization [req-59ed041d-df10-4da5-b78f-7e5ca200c5d6 req-8fa04e5f-1191-40e8-97cc-662c41a7a637 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1020.323932] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1020.326308] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.326484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.327258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.327258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.327258] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.327258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.327258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.327560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.327560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.327560] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.382323] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.382323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.382591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.382957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.383338] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.383588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.384294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.384294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.384294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.384294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.384496] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.384496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.384657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.384692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.385019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.385150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.385639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.385639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.385639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.385639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.385827] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.693958] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.693958] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.693958] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.693958] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.694391] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.694538] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.694711] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.695142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.695356] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.695631] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.695792] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.695950] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.697122] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.697122] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.697122] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.697122] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.718948] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.719147] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.719608] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.719608] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.720061] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.720061] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.720061] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.720417] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.720558] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfcb1c8b-4691-45b4-a753-3f119f4ebfdb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.830715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.830715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.830715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.830904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.830998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.831189] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.831284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.831345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.831495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.831566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.832254] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1020.862049] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.862049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.862049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.862049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.862049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.880631] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1020.888272] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d84857eb-b557-4aa2-8d62-34137b9cab1f: rpc.has_security_group_logging(os_id): False [ 1020.910024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.910200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.910200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.910424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.910550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.910750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.910936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.910936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.911170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.911249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.911460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.911587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.911643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.911815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.912685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.912685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.912685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.912685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.912685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.912685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.912685] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1020.982147] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.982389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.982494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.982849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.983071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.005377] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1021.223343] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.223343] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.223529] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.223715] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.223925] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.224069] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port bfcb1c8b-4691-45b4-a753-3f119f4ebfdb not found, creating... [ 1021.224326] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.224483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.224597] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.224910] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.225145] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.225443] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.225606] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.227569] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.227851] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.228069] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.228307] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: bfcb1c8b-4691-45b4-a753-3f119f4ebfdb is going to be created. [ 1021.251115] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.251115] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.251115] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.251115] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.251437] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.251437] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.977824] env[65630]: INFO networking_nsxv3.common.synchronization [req-59ed041d-df10-4da5-b78f-7e5ca200c5d6 req-6a2464f2-1be4-4699-9d24-ce8a4fa41ebe service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1021.978147] env[65630]: INFO networking_nsxv3.common.synchronization [req-59ed041d-df10-4da5-b78f-7e5ca200c5d6 req-6a2464f2-1be4-4699-9d24-ce8a4fa41ebe service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1021.978147] env[65630]: INFO networking_nsxv3.common.synchronization [req-59ed041d-df10-4da5-b78f-7e5ca200c5d6 req-6a2464f2-1be4-4699-9d24-ce8a4fa41ebe service nova] Enqueued Resource ID: bfcb1c8b-4691-45b4-a753-3f119f4ebfdb with Priority: HIGHEST for action port [ 1021.978694] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1021.978828] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1021.978930] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfcb1c8b-4691-45b4-a753-3f119f4ebfdb with Priority: HIGHEST for action port [ 1021.979907] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.980142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.980228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.980438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.980711] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.982952] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.983984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.983984] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.983984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.984299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.984299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.984583] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfcb1c8b-4691-45b4-a753-3f119f4ebfdb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.483840] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.483840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.486222] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfcb1c8b-4691-45b4-a753-3f119f4ebfdb with status ACTIVE [ 1022.486481] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.486635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.486701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.486972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.487116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.487323] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.487448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.487517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.488969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.488969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.488969] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.488969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.488969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.488969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.488969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.488969] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfcb1c8b-4691-45b4-a753-3f119f4ebfdb is going to be updated. [ 1022.511456] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.511456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.511456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.511697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.511780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.512275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfcb1c8b-4691-45b4-a753-3f119f4ebfdb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.891752] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1022.891973] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1022.892122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.892298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.892542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.892733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.892916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.892998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.893184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.893274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.893384] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.021854] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1023.022276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.395914] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.899019] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.401314] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.402186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.402186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.402186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.402186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.402186] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1024.437351] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.438129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.438129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.438129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.438129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.447452] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1026.460990] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1026.461461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.461461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.461693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.461937] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.462088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.462157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.462353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.462441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.462551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.462650] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.965674] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.965880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.966060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.966275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.966459] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.966577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.966619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.966773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.966938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.966938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.967108] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.967190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.967249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.967397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.967533] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.967659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.967714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.967805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.967878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.967956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.968085] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.979479] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1026.979565] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1027.215613] env[65630]: INFO networking_nsxv3.common.synchronization [req-20b0eebd-b91d-4eca-bb16-8ec8913d5e11 req-043c1508-4756-4c9d-934f-3b73695539da tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1027.216199] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1027.216833] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.217720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.217720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.217720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.217720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.217720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.217720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.218276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.218437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.218568] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.254787] env[65630]: INFO networking_nsxv3.common.synchronization [req-6ab4a1a6-0077-473a-bb17-968c338bdf78 req-bcfb7031-1f17-4d01-999a-f40995cc291f tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_members [ 1027.255460] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_members [ 1027.255711] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-260959d6-44de-432d-a8ee-ce634ff440ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.255838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.255909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.257765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.257943] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.258071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.258133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.258309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.258393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.258489] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.470264] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71bd905-a59a-420e-96dc-4f48e2b11e86: rpc.has_security_group_logging(os_id): False [ 1027.494180] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.494364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.494442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.494924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.495105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.495375] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.495509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.495608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.495805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.495915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.496423] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.496506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.496547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.496762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.496913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.497279] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.497413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.497482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.497670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.497772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.497912] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1027.582715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.583284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.583284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.586325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.586458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.600506] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.600779] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.601018] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.601441] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.602039] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.602142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.602283] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.602660] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.602997] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.603317] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.603493] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.603660] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.603826] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.603987] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.604174] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.604345] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.606346] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1027.636647] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.636896] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.637024] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.637207] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.637573] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-6d1a6084-a467-4470-93cc-dac149dab970 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.637796] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.637952] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.638388] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.638572] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d1a6084-a467-4470-93cc-dac149dab970',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.720637] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.763405] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.763405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.763405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.763405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.763720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.763720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.768409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.768409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.768409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.768409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.768409] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260959d6-44de-432d-a8ee-ce634ff440ed already deleted. [ 1027.768409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.141046] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.141324] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.141469] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.141824] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.142085] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.142311] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 6d1a6084-a467-4470-93cc-dac149dab970 not found, creating... [ 1028.142922] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.143190] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.143376] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.143700] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.143944] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.144411] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.144636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.144805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.145162] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.145340] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.145537] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 6d1a6084-a467-4470-93cc-dac149dab970 is going to be created. [ 1028.171201] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.171448] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.171662] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.173787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.173787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.173787] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.223156] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.727683] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.727683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.728819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.728819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.728819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.728819] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1028.773209] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.773336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.773388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.773583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.773781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.789349] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1029.045728] env[65630]: INFO networking_nsxv3.common.synchronization [req-6ab4a1a6-0077-473a-bb17-968c338bdf78 req-1b7b4deb-d775-4be6-a308-914b15a74b2b service nova] Enqueued Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_rules [ 1029.046092] env[65630]: INFO networking_nsxv3.common.synchronization [req-6ab4a1a6-0077-473a-bb17-968c338bdf78 req-1b7b4deb-d775-4be6-a308-914b15a74b2b service nova] Enqueued Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_members [ 1029.046295] env[65630]: INFO networking_nsxv3.common.synchronization [req-6ab4a1a6-0077-473a-bb17-968c338bdf78 req-1b7b4deb-d775-4be6-a308-914b15a74b2b service nova] Enqueued Resource ID: 6d1a6084-a467-4470-93cc-dac149dab970 with Priority: HIGHEST for action port [ 1029.046926] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_rules [ 1029.047089] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_members [ 1029.047189] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d1a6084-a467-4470-93cc-dac149dab970 with Priority: HIGHEST for action port [ 1029.047521] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-260959d6-44de-432d-a8ee-ce634ff440ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.048010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.048092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.048318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.048408] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.049448] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-260959d6-44de-432d-a8ee-ce634ff440ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.049628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.049755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.049952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.050090] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.050198] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.050251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.050407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.050491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.050586] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.051624] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d1a6084-a467-4470-93cc-dac149dab970 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.051740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.052704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.052704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.052704] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d1a6084-a467-4470-93cc-dac149dab970',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.356902] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1029.357083] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1029.554575] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-260959d6-44de-432d-a8ee-ce634ff440ed taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.554575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.554904] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.555893] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d1a6084-a467-4470-93cc-dac149dab970 with status ACTIVE [ 1029.556124] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.556257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.556322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.556525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.556613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.556792] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.556887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.556942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.557093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.557171] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.557400] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.557466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.557557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.557708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.557783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.557870] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d1a6084-a467-4470-93cc-dac149dab970 is going to be updated. [ 1029.582660] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.582915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.583044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.583357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.583581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.583868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d1a6084-a467-4470-93cc-dac149dab970" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.626735] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1029.627184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.060898] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.532964] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.533304] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.533554] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.533827] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.534103] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.534268] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.534455] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.534756] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.534917] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.535180] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.535350] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.535350] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.535464] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.535599] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.535703] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.535788] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.565413] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.565644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.565726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.566032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.566215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.567152] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260959d6-44de-432d-a8ee-ce634ff440ed is going to be created. [ 1030.599099] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.599541] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.599794] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.600019] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.600402] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-d786454e-d9cf-43a5-9a63-c3105e6ae621 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.600538] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.600668] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.600998] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.601168] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d786454e-d9cf-43a5-9a63-c3105e6ae621',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.603229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.603358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.603437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.603711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.603872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.622982] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260959d6-44de-432d-a8ee-ce634ff440ed in Status: UNINITIALIZED for 2s [ 1030.803569] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1030.803569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.107855] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.108150] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.108186] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.108696] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.108696] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.110042] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.110042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.110042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.110042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.110042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.110042] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.110435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.110435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.110656] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.110870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.111061] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 is going to be updated. [ 1031.138499] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.138750] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.138885] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.139227] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.139470] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.139797] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.800757] env[65630]: INFO networking_nsxv3.common.synchronization [req-a8d3328d-7781-47e4-a4ff-60426dd5e347 req-71705c6b-f663-4535-9425-8bca130456ae service nova] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 1031.800991] env[65630]: INFO networking_nsxv3.common.synchronization [req-a8d3328d-7781-47e4-a4ff-60426dd5e347 req-71705c6b-f663-4535-9425-8bca130456ae service nova] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 1031.801969] env[65630]: INFO networking_nsxv3.common.synchronization [req-a8d3328d-7781-47e4-a4ff-60426dd5e347 req-71705c6b-f663-4535-9425-8bca130456ae service nova] Enqueued Resource ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 with Priority: HIGHEST for action port [ 1031.802690] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_rules [ 1031.802936] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 1031.803093] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 with Priority: HIGHEST for action port [ 1031.803436] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.803600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.803694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.804327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.804450] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.806176] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.807354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.807790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.807790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.807876] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.807994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.808094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.808276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.808381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.808482] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.809406] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d786454e-d9cf-43a5-9a63-c3105e6ae621 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.809524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.809598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.809783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.810830] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d786454e-d9cf-43a5-9a63-c3105e6ae621',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.306992] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.307679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.311818] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.313083] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d786454e-d9cf-43a5-9a63-c3105e6ae621 with status ACTIVE [ 1032.313437] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.313437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.313568] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.313798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.313944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.314231] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.314376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.314427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.315100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.315100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.315100] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.315100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.315333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.315333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.315400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.317596] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d786454e-d9cf-43a5-9a63-c3105e6ae621 is going to be updated. [ 1032.345341] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.345540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.345583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.345832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.346070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.346314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d786454e-d9cf-43a5-9a63-c3105e6ae621" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.637879] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260959d6-44de-432d-a8ee-ce634ff440ed in Status: SUCCESS [ 1032.638115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.638282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.638510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.638699] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.638815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.638880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.639039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.639123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.639260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.639371] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.818399] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.025346] env[65630]: INFO networking_nsxv3.common.synchronization [req-8e7a68cd-afdd-41a2-b285-c6a2d3b7a76e req-530dd22d-c291-4a54-b5cf-99398c1efaee tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1033.026112] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1033.026239] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.026313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.026417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.026581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.026763] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.026877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.026977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.027116] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.027228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.027321] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.051206] env[65630]: INFO networking_nsxv3.common.synchronization [req-8e7a68cd-afdd-41a2-b285-c6a2d3b7a76e req-530dd22d-c291-4a54-b5cf-99398c1efaee tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 1033.051345] env[65630]: INFO networking_nsxv3.common.synchronization [req-8e7a68cd-afdd-41a2-b285-c6a2d3b7a76e req-530dd22d-c291-4a54-b5cf-99398c1efaee tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1033.051430] env[65630]: INFO networking_nsxv3.common.synchronization [req-8e7a68cd-afdd-41a2-b285-c6a2d3b7a76e req-530dd22d-c291-4a54-b5cf-99398c1efaee tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 with Priority: HIGHEST for action port [ 1033.051958] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 1033.052185] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1033.052242] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 with Priority: HIGHEST for action port [ 1033.053335] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.053335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.053335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.053335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.053335] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.054609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.054609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.054769] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b37434d-91d8-4a57-939e-109b22cf8c67 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.054837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.054918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.055094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.055169] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37434d-91d8-4a57-939e-109b22cf8c67',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.143041] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.321069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.321387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.321387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.321821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.321821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.321925] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 is going to be updated. [ 1033.368374] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.368559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.368601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.368805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.369151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.379019] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: IN_PROGRESS for 2s [ 1033.501933] env[65630]: INFO networking_nsxv3.common.synchronization [req-860c43e9-7559-466d-a734-5dd0ce9c27bb req-70d949f5-287a-4d83-ab65-97c5f3056972 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1033.503108] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1033.503108] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.503108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.503108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.503356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.503449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.503557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.503618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.503757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.503841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.503940] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.529330] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.556890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.557043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.557315] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b37434d-91d8-4a57-939e-109b22cf8c67 with status ACTIVE [ 1033.557528] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.557659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.557743] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.558026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.558125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.558378] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.558637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.558637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.558845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.558937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.559177] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.559300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.559406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.559635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.559724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.559849] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 is going to be updated. [ 1033.583927] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.585525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.585525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.585525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.585525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.585525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.647710] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 260959d6-44de-432d-a8ee-ce634ff440ed: rpc.has_security_group_logging(os_id): False [ 1033.670031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.670031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.670031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.670031] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 260959d6-44de-432d-a8ee-ce634ff440ed is going to be created. [ 1033.803691] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.803884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.804152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.804508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.804741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.819022] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 260959d6-44de-432d-a8ee-ce634ff440ed in Status: IN_PROGRESS for 2s [ 1033.949313] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.949522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.949650] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.949920] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.950239] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.950362] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.950483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.950752] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.950938] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.951179] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.951292] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.951405] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.951516] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.951620] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.951723] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.951856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.988769] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.988925] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1033.989080] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.989264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.989598] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-08b887f7-4289-4ba0-902a-a8c41ab290bc taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.989822] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.989981] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.991308] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.991308] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b887f7-4289-4ba0-902a-a8c41ab290bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.005915] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.006163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.006242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.006519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.006622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.006835] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.006936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.006994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.007163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.007994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.007994] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 already deleted. [ 1034.007994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.033709] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.494313] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.494677] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.494677] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.495068] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.495264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.495472] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 08b887f7-4289-4ba0-902a-a8c41ab290bc not found, creating... [ 1034.495852] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.496096] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.496302] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.496604] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.497050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.497121] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.497440] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.497625] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.497922] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.498106] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.498284] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 08b887f7-4289-4ba0-902a-a8c41ab290bc is going to be created. [ 1034.521249] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.521572] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.521660] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.521965] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.522238] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.522483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.533638] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.533925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.534075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.534412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.534567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.535198] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be updated. [ 1034.575454] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.575454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.575454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.575709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.575957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.589981] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 1035.249419] env[65630]: INFO networking_nsxv3.common.synchronization [req-860c43e9-7559-466d-a734-5dd0ce9c27bb req-2f018685-5428-4742-9a92-5a0af3c5c310 service nova] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_rules [ 1035.249513] env[65630]: INFO networking_nsxv3.common.synchronization [req-860c43e9-7559-466d-a734-5dd0ce9c27bb req-2f018685-5428-4742-9a92-5a0af3c5c310 service nova] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1035.249653] env[65630]: INFO networking_nsxv3.common.synchronization [req-860c43e9-7559-466d-a734-5dd0ce9c27bb req-2f018685-5428-4742-9a92-5a0af3c5c310 service nova] Enqueued Resource ID: 08b887f7-4289-4ba0-902a-a8c41ab290bc with Priority: HIGHEST for action port [ 1035.250231] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_rules [ 1035.250371] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1035.250467] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b887f7-4289-4ba0-902a-a8c41ab290bc with Priority: HIGHEST for action port [ 1035.250756] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.250910] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.250984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.251268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.251342] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.252686] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.252686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.252797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.252946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.253211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.253319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.253383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.253537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.253704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.253798] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.254700] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-08b887f7-4289-4ba0-902a-a8c41ab290bc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.254810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.254876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.255075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.255154] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b887f7-4289-4ba0-902a-a8c41ab290bc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.390067] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: SUCCESS [ 1035.390305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.390885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.391125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.391330] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.391448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.391515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.391681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.391763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.391849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.391942] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.756838] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.758160] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.758348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.758461] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08b887f7-4289-4ba0-902a-a8c41ab290bc with status ACTIVE [ 1035.758612] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.758730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.758816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.758996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.759190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.759267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.759370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.759433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.759583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.759647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.759832] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.759932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.760048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.760120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.760176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.760270] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08b887f7-4289-4ba0-902a-a8c41ab290bc is going to be updated. [ 1035.785253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.785476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.785519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.785800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.785985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.786172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08b887f7-4289-4ba0-902a-a8c41ab290bc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.846042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 260959d6-44de-432d-a8ee-ce634ff440ed in Status: SUCCESS [ 1035.846363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.894453] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.265029] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.398600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34ac1819-3d29-4b4e-ac83-e39408cd6e49: rpc.has_security_group_logging(os_id): False [ 1036.428831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.428831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.428831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.428831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.463241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.463241] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.463406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.463406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.463553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.463687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.463804] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 is going to be updated. [ 1036.533265] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.533551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.533551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.533784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.533908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.551070] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: IN_PROGRESS for 2s [ 1036.604734] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 1036.604829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.605024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.605293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.605499] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.605619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.605704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.605896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.606231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.606231] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.750360] env[65630]: INFO networking_nsxv3.common.synchronization [req-d88c6d3a-2e3a-4d44-8f01-ce9e17667f69 req-3779e65f-4edd-4f28-990a-edb489a81829 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1036.751358] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1036.751709] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.751831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.751867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.752516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.752730] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.752939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.753010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.753271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.753373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.753477] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.766615] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.769410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.770579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.770579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.770579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.770579] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be created. [ 1036.811235] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.811475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.811541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.811816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.811952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.825252] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: UNINITIALIZED for 2s [ 1037.108539] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.218656] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.218656] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.219097] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.219257] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.219622] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.219847] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.219992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.220333] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.220509] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.220762] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.220951] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.221099] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.221236] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.221393] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.221562] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.221729] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.242767] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.243082] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.243267] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.243519] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.243998] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-de563a7d-b900-4f91-8c8f-f7b960f710bb taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.244322] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.244487] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.244931] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.245175] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de563a7d-b900-4f91-8c8f-f7b960f710bb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.256921] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.257176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.257262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.257480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.257569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.257775] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.257867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.257927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.258088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.258186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.258279] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 already deleted. [ 1037.258371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.279020] env[65630]: INFO networking_nsxv3.common.synchronization [req-421db15b-8d17-4d70-920e-30737b4b48c3 req-e260ea86-a16d-4fce-8995-958339fb8345 tempest-MigrationsAdminTest-1222576144 tempest-MigrationsAdminTest-1222576144-project-member] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 1037.279020] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 1037.279020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.279020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.279020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.279020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.279020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.279020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.279020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.279020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.279020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.279020] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.611551] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.748300] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.748611] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.748716] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.749055] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.749228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.749389] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port de563a7d-b900-4f91-8c8f-f7b960f710bb not found, creating... [ 1037.749697] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.749872] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.749992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.750236] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.750372] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.750987] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.751220] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.751342] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.751556] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.751690] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.751849] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: de563a7d-b900-4f91-8c8f-f7b960f710bb is going to be created. [ 1037.773997] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.774370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.774470] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.774752] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.775396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.775396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.780044] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.116746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.116970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.116970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.117274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.117584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.117841] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be updated. [ 1038.161940] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.162200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.162308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.162654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.162975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.175093] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 1038.282415] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.547273] env[65630]: INFO networking_nsxv3.common.synchronization [req-d88c6d3a-2e3a-4d44-8f01-ce9e17667f69 req-def29c06-31ab-422d-bb45-341047f521a8 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1038.548154] env[65630]: INFO networking_nsxv3.common.synchronization [req-d88c6d3a-2e3a-4d44-8f01-ce9e17667f69 req-def29c06-31ab-422d-bb45-341047f521a8 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1038.548154] env[65630]: INFO networking_nsxv3.common.synchronization [req-d88c6d3a-2e3a-4d44-8f01-ce9e17667f69 req-def29c06-31ab-422d-bb45-341047f521a8 service nova] Enqueued Resource ID: de563a7d-b900-4f91-8c8f-f7b960f710bb with Priority: HIGHEST for action port [ 1038.548856] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1038.548971] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1038.549237] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de563a7d-b900-4f91-8c8f-f7b960f710bb with Priority: HIGHEST for action port [ 1038.549699] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.549919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.550066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.550474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.550542] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.551792] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.553066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.553143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.553331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.554235] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.554542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.554629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.555816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.555816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.555816] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.556764] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-de563a7d-b900-4f91-8c8f-f7b960f710bb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.556883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.556953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.558713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.558808] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de563a7d-b900-4f91-8c8f-f7b960f710bb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.566559] env[65630]: INFO networking_nsxv3.common.synchronization [req-9f8d1ce7-1fd6-406d-898e-19e3114dfa23 req-8c399149-d3b0-466e-9ebe-6ffc038401d2 tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1038.567570] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1038.568063] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.568188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.581445] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: SUCCESS [ 1038.581544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.586983] env[65630]: INFO networking_nsxv3.common.synchronization [req-9f8d1ce7-1fd6-406d-898e-19e3114dfa23 req-8c399149-d3b0-466e-9ebe-6ffc038401d2 tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 1038.587224] env[65630]: INFO networking_nsxv3.common.synchronization [req-9f8d1ce7-1fd6-406d-898e-19e3114dfa23 req-8c399149-d3b0-466e-9ebe-6ffc038401d2 tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1038.589746] env[65630]: INFO networking_nsxv3.common.synchronization [req-9f8d1ce7-1fd6-406d-898e-19e3114dfa23 req-8c399149-d3b0-466e-9ebe-6ffc038401d2 tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 with Priority: HIGHEST for action port [ 1038.589746] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_rules [ 1038.589746] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1038.589746] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 with Priority: HIGHEST for action port [ 1038.589746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.589746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.589746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.589746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.589746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b37434d-91d8-4a57-939e-109b22cf8c67 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.590382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.590382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.590456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.590758] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b37434d-91d8-4a57-939e-109b22cf8c67',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.785415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.785415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.785415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.785948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.785948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.785948] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 is going to be updated. [ 1038.829384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.829384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.829384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.829384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.829384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.847389] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: SUCCESS [ 1038.847685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.847942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.848216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.848489] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.848672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.848866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.849053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.849158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.849510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.849510] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.851686] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: IN_PROGRESS for 2s [ 1039.061406] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.061406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.061406] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.062291] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de563a7d-b900-4f91-8c8f-f7b960f710bb with status ACTIVE [ 1039.062661] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.062661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.062661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.063135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.063135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.063344] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.063437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.063503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.063663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.063867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.063992] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.068031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.068031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.068031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.068031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.068031] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de563a7d-b900-4f91-8c8f-f7b960f710bb is going to be updated. [ 1039.089715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.090037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.090037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.090247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.090392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.090577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de563a7d-b900-4f91-8c8f-f7b960f710bb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095197] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b37434d-91d8-4a57-939e-109b22cf8c67 with status ACTIVE [ 1039.095197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.095197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.095197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.095197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.095197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.095197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.095571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.095571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.095571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095656] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.095844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.095844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.095963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.096061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.096099] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b37434d-91d8-4a57-939e-109b22cf8c67 is going to be updated. [ 1039.125850] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.126083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.126083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.126309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.126427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.126590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b37434d-91d8-4a57-939e-109b22cf8c67" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.356455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.356455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.356455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.356455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.357162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.357162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.357162] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.357162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.357162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.357925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.357925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.357925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.357925] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.568023] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.861474] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 201b4cc2-0baa-4c4b-b457-1bb173e25095: rpc.has_security_group_logging(os_id): False [ 1039.886284] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.886739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.886918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.887840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.888265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.889573] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.889573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.889573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.889907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.889907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.890522] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.890926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.891077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.891563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.892210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.892353] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.893082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.893082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.893318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.893506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.893685] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be created. [ 1039.968836] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.969058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.969058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.969356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.969534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.986392] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: IN_PROGRESS for 2s [ 1040.074251] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.074251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.074251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.074251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.074528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.074528] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be created. [ 1040.109775] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.111260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.111260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.111260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.111260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.121463] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: UNINITIALIZED for 2s [ 1040.186978] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 1040.187261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.187465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.187680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.187877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.188049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.188143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.188239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.188304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.188392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.188538] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.190223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.190562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.190750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.190888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.191039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.191206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.191294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.191392] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.694504] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.695978] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.864916] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: SUCCESS [ 1040.868421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.200123] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f69e9012-529a-49ae-80ce-87883c1f49fe: rpc.has_security_group_logging(os_id): False [ 1041.200123] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.222637] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.222891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.222891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.223205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.223300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.223558] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.223662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.223720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.223880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.223958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.224062] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be updated. [ 1041.290829] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.291036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.291132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.291506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.291665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.307703] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 1041.707826] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.707826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.707826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.707826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.707826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.707826] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be updated. [ 1041.754996] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.755177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.755334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.755448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.755597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.785044] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 1042.000231] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: SUCCESS [ 1042.000548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.132110] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1042.132347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.132515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.132740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.132971] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.133151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.133221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.133436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.133507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.133559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.133663] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.377804] env[65630]: INFO networking_nsxv3.common.synchronization [req-1af5b2cc-8f9e-468c-883b-834fcc7436a9 req-1ff77c7f-16da-4281-b2b7-18547c7b6584 tempest-ServersTestManualDisk-1045302247 tempest-ServersTestManualDisk-1045302247-project-member] Enqueued Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_members [ 1042.378449] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_members [ 1042.379173] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-24ebd7ab-0776-4822-9b99-4e4b98571494 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.379173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.379173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.384193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.384431] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.384565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.384656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.384824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.384926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.385050] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.636952] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.637224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.637407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.637533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.641027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.641027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.641027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.641027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.641027] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.821846] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.822100] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-815" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.822849] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-815" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.822849] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-815" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.823126] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.825041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.825041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.827082] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.827355] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.827732] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.827917] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.828051] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.828198] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.828358] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.828585] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.828772] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.850373] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.850373] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.850606] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.850785] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-815" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.852748] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-4a707f82-6234-4046-8042-a7d6fa284373 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.852845] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.853062] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.853544] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.853765] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a707f82-6234-4046-8042-a7d6fa284373',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.889205] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.889476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.889583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.889894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.890017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.890329] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.890464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.890550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.890770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.890968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.891109] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 already deleted. [ 1042.891215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.144833] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed098d0-aa55-4a88-be4f-3fe063ee74f6: rpc.has_security_group_logging(os_id): False [ 1043.165470] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.165673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.166084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.166084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.166224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.166371] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.166489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.166582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.166797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.166905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.167361] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.167361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.167495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.167622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.167742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.167997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.168117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.168200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.168353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.168432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.168520] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be created. [ 1043.229559] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.229769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.229769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.230031] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.230230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.242956] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1043.350887] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 1043.351231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.351856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.352138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.352259] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.357746] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.358076] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.358264] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.358564] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.358716] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.358871] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 4a707f82-6234-4046-8042-a7d6fa284373 not found, creating... [ 1043.359205] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.359431] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.359552] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.359816] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.359959] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.360282] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.360533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.360693] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.361587] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.361755] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.361912] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 4a707f82-6234-4046-8042-a7d6fa284373 is going to be created. [ 1043.395396] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.395667] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.395792] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.396064] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.396332] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.396606] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.796332] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 1043.796597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.796777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.797062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.797339] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.797438] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.797477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.797669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.797760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.797852] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.854973] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.855200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.156666] env[65630]: INFO networking_nsxv3.common.synchronization [req-1af5b2cc-8f9e-468c-883b-834fcc7436a9 req-512231f9-3709-46ee-82a8-9d1c9647f3fe service nova] Enqueued Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_rules [ 1044.156666] env[65630]: INFO networking_nsxv3.common.synchronization [req-1af5b2cc-8f9e-468c-883b-834fcc7436a9 req-512231f9-3709-46ee-82a8-9d1c9647f3fe service nova] Enqueued Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_members [ 1044.156666] env[65630]: INFO networking_nsxv3.common.synchronization [req-1af5b2cc-8f9e-468c-883b-834fcc7436a9 req-512231f9-3709-46ee-82a8-9d1c9647f3fe service nova] Enqueued Resource ID: 4a707f82-6234-4046-8042-a7d6fa284373 with Priority: HIGHEST for action port [ 1044.156666] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_rules [ 1044.156666] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_members [ 1044.156666] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a707f82-6234-4046-8042-a7d6fa284373 with Priority: HIGHEST for action port [ 1044.156666] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24ebd7ab-0776-4822-9b99-4e4b98571494 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.156666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.156666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.156666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.156666] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.157306] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-24ebd7ab-0776-4822-9b99-4e4b98571494 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.157306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.157306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.157306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.157509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.157606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.157668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.157823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.157919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.158377] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.159286] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a707f82-6234-4046-8042-a7d6fa284373 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.159402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.159603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.159603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.159694] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a707f82-6234-4046-8042-a7d6fa284373',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.300597] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.661658] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-24ebd7ab-0776-4822-9b99-4e4b98571494 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.661794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.664454] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.665797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a707f82-6234-4046-8042-a7d6fa284373 with status ACTIVE [ 1044.666197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.666302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.666418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.666729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.666890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.667478] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.667601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.668138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.668358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.668540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.669178] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.669291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.669358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.669604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.669756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.669905] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a707f82-6234-4046-8042-a7d6fa284373 is going to be updated. [ 1044.696891] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.696891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.696891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.697170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.697264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.697397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a707f82-6234-4046-8042-a7d6fa284373" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.804031] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.945489] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4581a14-e74c-44c1-808a-005ff6c47c12 req-74bf1499-1612-41eb-9b11-6d5900b3020b tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1044.946110] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1044.948343] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.948343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.948343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.948343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.948343] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.948343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.948799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.948799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.948799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.948991] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.174434] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.256378] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1045.256628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.306867] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.307083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.307129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.307361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.307458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.307564] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be updated. [ 1045.338159] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.338333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.338333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.338614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.338809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.350026] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 1045.372808] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.373161] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.373335] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.373867] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.374181] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.374395] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.374570] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.374972] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.375572] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.375572] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.376922] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.376922] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.376922] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.376922] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.376922] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.376922] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.397856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.398060] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.398215] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.398412] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.398784] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-d7f72abd-691f-46c3-aaae-e96938e6c528 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.398950] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.399076] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.399470] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.399623] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7f72abd-691f-46c3-aaae-e96938e6c528',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.451177] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.451368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.451408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.451769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.451867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.452174] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.452330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.452417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.452601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.452706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.452849] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1045.498178] env[65630]: INFO networking_nsxv3.common.synchronization [req-e545e8da-6f7c-4b21-af33-38da168ec451 req-af6659a6-282c-481e-9fff-e1643318a339 tempest-AttachInterfacesUnderV243Test-517757366 tempest-AttachInterfacesUnderV243Test-517757366-project-member] Enqueued Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1045.498679] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69e9012-529a-49ae-80ce-87883c1f49fe with Priority: HIGHEST for action security_group_members [ 1045.499211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69e9012-529a-49ae-80ce-87883c1f49fe taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.499938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.501987] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.502253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.502345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.502681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.503034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.521995] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1045.683516] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.684698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.684698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.684698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.684698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.684698] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 is going to be created. [ 1045.723352] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.723508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.723576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.723838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.724077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.739480] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 in Status: UNINITIALIZED for 2s [ 1045.902776] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.903116] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.903253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.903593] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.903807] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.903976] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port d7f72abd-691f-46c3-aaae-e96938e6c528 not found, creating... [ 1045.904322] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.904474] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.904611] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.904865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.905025] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.909105] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.909417] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.909600] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.909936] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.910253] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.910518] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: d7f72abd-691f-46c3-aaae-e96938e6c528 is going to be created. [ 1045.933990] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.934534] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.934746] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.935101] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.935426] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.935742] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.653154] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4581a14-e74c-44c1-808a-005ff6c47c12 req-818d1668-7a48-4da3-a0bf-0f9ad449d72d service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 1046.653154] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4581a14-e74c-44c1-808a-005ff6c47c12 req-818d1668-7a48-4da3-a0bf-0f9ad449d72d service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1046.653154] env[65630]: INFO networking_nsxv3.common.synchronization [req-a4581a14-e74c-44c1-808a-005ff6c47c12 req-818d1668-7a48-4da3-a0bf-0f9ad449d72d service nova] Enqueued Resource ID: d7f72abd-691f-46c3-aaae-e96938e6c528 with Priority: HIGHEST for action port [ 1046.653154] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 1046.653154] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1046.653154] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7f72abd-691f-46c3-aaae-e96938e6c528 with Priority: HIGHEST for action port [ 1046.653154] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.653154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.653154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.657187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.657187] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.657187] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.657187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.657187] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7f72abd-691f-46c3-aaae-e96938e6c528 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.657187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.657187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.657187] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.657187] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7f72abd-691f-46c3-aaae-e96938e6c528',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.160036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.160036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.160036] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7f72abd-691f-46c3-aaae-e96938e6c528 with status ACTIVE [ 1047.160284] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.160348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.160386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.160598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.160719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.160918] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.161105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.161166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.161294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.161375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.161588] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.161685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.161762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.162072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.162072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.162200] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7f72abd-691f-46c3-aaae-e96938e6c528 is going to be updated. [ 1047.188245] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.188245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.188245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.188419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.188539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.188705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7f72abd-691f-46c3-aaae-e96938e6c528" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.363264] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 1047.363487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.363775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.364140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.364529] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.364672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.364757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.365017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.365157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.365362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.365570] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.366701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.367070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.367230] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.367436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.367513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.367719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.367878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.368031] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.534763] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1047.535628] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 deletion is rescheduled due to dependency. [ 1047.535628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.535628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.535628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.535869] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.535869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.535869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.536013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.536092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.536190] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.751448] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 in Status: SUCCESS [ 1047.751795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.751851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.752068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.752268] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.752389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.752455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.752621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.752703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.752786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.752877] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.870567] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f69e9012-529a-49ae-80ce-87883c1f49fe',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.871932] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.872113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.872113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.872315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.872398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.872620] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.872763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.872814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.872989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.873178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.873311] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be updated. [ 1047.903652] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.903820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.903882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.904239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.904351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.914823] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 1048.039804] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.255237] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.376351] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f69e9012-529a-49ae-80ce-87883c1f49fe: rpc.has_security_group_logging(os_id): False [ 1048.400946] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.401241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.401322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.401667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.401816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.402229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.402366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.402482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.402826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.402826] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.402826] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe is going to be updated. [ 1048.503392] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.503563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.503675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.503971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.504788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.530364] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: IN_PROGRESS for 2s [ 1048.535901] env[65630]: INFO networking_nsxv3.common.synchronization [None req-03b0dfff-eb69-43a9-873c-f356ab96707b tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 51b8e381-32f2-46bf-8c60-5ce647ebb1b9 with Priority: HIGHEST for action security_group_rules [ 1048.536489] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b8e381-32f2-46bf-8c60-5ce647ebb1b9 with Priority: HIGHEST for action security_group_rules [ 1048.536808] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.537029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.537029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.537319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.537360] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51b8e381-32f2-46bf-8c60-5ce647ebb1b9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.542065] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.639439] env[65630]: INFO networking_nsxv3.common.synchronization [None req-f75f49f7-1be1-4fc8-8300-4f58669f6d83 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 51b8e381-32f2-46bf-8c60-5ce647ebb1b9 with Priority: HIGHEST for action security_group_rules [ 1048.641217] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b8e381-32f2-46bf-8c60-5ce647ebb1b9 with Priority: HIGHEST for action security_group_rules [ 1048.641217] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.641217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.758467] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24ebd7ab-0776-4822-9b99-4e4b98571494: rpc.has_security_group_logging(os_id): False [ 1048.782121] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.782121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.782752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.782934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.783154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.783364] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.783492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.783558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.783725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.783805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.783919] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 is going to be created. [ 1048.858388] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.858388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.858388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.858388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.858388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.870868] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 in Status: IN_PROGRESS for 2s [ 1049.046104] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.046104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.046104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.046104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.046104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.046104] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1049.066364] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.066364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.066364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.066364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.066870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.067096] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51b8e381-32f2-46bf-8c60-5ce647ebb1b9 already deleted. [ 1049.068415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.068415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.068415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.068415] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51b8e381-32f2-46bf-8c60-5ce647ebb1b9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.081645] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.084019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.084019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.084019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.084019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.098383] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1049.593890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.593890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.593890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.593890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.593890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.593890] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51b8e381-32f2-46bf-8c60-5ce647ebb1b9 already deleted. [ 1049.593890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51b8e381-32f2-46bf-8c60-5ce647ebb1b9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.928707] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 1049.929091] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69e9012-529a-49ae-80ce-87883c1f49fe deletion is rescheduled due to dependency. [ 1049.929091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.588211] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69e9012-529a-49ae-80ce-87883c1f49fe in Status: SUCCESS [ 1050.588450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69e9012-529a-49ae-80ce-87883c1f49fe" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.888552] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 in Status: SUCCESS [ 1050.888864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.116413] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1051.116767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.116842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.118022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.118022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.118022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.118022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.118022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.118022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.118022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.118022] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.620415] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.124964] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397b25ae-6929-46ce-8711-37502e4943b3: rpc.has_security_group_logging(os_id): False [ 1052.145152] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.145370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.145370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.145856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.145856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.146135] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.146191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.146233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.146387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.146460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.146545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1052.212679] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.212804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.212877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.213195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.213318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.226042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1052.284038] env[65630]: INFO networking_nsxv3.common.synchronization [req-3405e6f4-5e92-4cd8-8434-c7007c2ddb0b req-904f00fc-1d5d-45a1-9682-25148d6c21a9 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1052.285275] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1052.285642] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.285816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.285997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.286262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.286358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.286758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.286758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.286758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.286758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.286970] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.789508] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.789667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.789667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.789879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.789969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.790215] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.790344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.790387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.790529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.790647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.790786] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1052.821549] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.821793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.821793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.822052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.822233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.834379] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1054.241055] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1054.242037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.846082] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1054.846411] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 1054.846578] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.315204] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.315531] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.315531] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.315800] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.316216] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.316216] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.316423] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.316567] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.316882] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.317199] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.317341] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.317463] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.317587] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.317772] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.317894] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.318042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.341688] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.341848] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.342013] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.342199] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-596" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.342550] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-ba559057-9d08-428b-835d-0b2b06025dfc taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.342730] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.343122] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.343469] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.343619] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba559057-9d08-428b-835d-0b2b06025dfc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.847542] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.847826] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.847936] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.848298] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.848499] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.848823] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.849015] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.849162] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.849415] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.849591] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.849903] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.850098] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.850278] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.850499] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.850653] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.850809] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: ba559057-9d08-428b-835d-0b2b06025dfc is going to be updated. [ 1055.875229] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.876050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.876050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.876050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.876306] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.876600] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.140329] env[65630]: INFO networking_nsxv3.common.synchronization [req-cb0e1bb4-0df8-4cda-8a40-a9fd0681b154 req-1d6947e2-5496-494a-a6dc-0274c18ef2cc tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_members [ 1056.140586] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGHEST for action security_group_members [ 1056.140895] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.141326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.141326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.141483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.141636] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.141738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.141791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.141934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.142049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.142143] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.572313] env[65630]: INFO networking_nsxv3.common.synchronization [req-7124e984-7233-4eb1-9275-0109ab63a200 req-44f1d572-56d2-4462-9e1c-8556b3442bb3 service nova] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_rules [ 1056.572313] env[65630]: INFO networking_nsxv3.common.synchronization [req-7124e984-7233-4eb1-9275-0109ab63a200 req-44f1d572-56d2-4462-9e1c-8556b3442bb3 service nova] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 1056.572313] env[65630]: INFO networking_nsxv3.common.synchronization [req-7124e984-7233-4eb1-9275-0109ab63a200 req-44f1d572-56d2-4462-9e1c-8556b3442bb3 service nova] Enqueued Resource ID: ba559057-9d08-428b-835d-0b2b06025dfc with Priority: HIGHEST for action port [ 1056.572313] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_rules [ 1056.572313] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 1056.572313] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba559057-9d08-428b-835d-0b2b06025dfc with Priority: HIGHEST for action port [ 1056.572313] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.572313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.572313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.573544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.573892] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.576649] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.577300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.577300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.577791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.578265] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.579124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.579124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.579343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.579703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.580188] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.582632] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba559057-9d08-428b-835d-0b2b06025dfc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.582632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.582864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.582957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.583135] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba559057-9d08-428b-835d-0b2b06025dfc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.644485] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.644759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.644870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.645152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.645272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.645508] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.645629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.645707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.645886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.645978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.646096] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044f1395-427c-4906-bf47-71c561e2457d is going to be updated. [ 1056.677325] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.677325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.677563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.678146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.678146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.692545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044f1395-427c-4906-bf47-71c561e2457d in Status: IN_PROGRESS for 2s [ 1057.085584] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.085777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.085941] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.087023] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba559057-9d08-428b-835d-0b2b06025dfc with status ACTIVE [ 1057.087184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.088407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.088407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.088532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.088625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.088820] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.088940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.089013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.089230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.089340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.089538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.089649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.089711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.090159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.090245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.090338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba559057-9d08-428b-835d-0b2b06025dfc is going to be updated. [ 1057.115868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.116056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.116056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.116290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.116424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.116594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba559057-9d08-428b-835d-0b2b06025dfc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.593216] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.096027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.096027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.096027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.096321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.096361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.096472] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be updated. [ 1058.129097] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.129261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.129345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.129618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.129768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.141234] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 1058.702904] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044f1395-427c-4906-bf47-71c561e2457d in Status: SUCCESS [ 1058.703367] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044f1395-427c-4906-bf47-71c561e2457d deletion is rescheduled due to dependency. [ 1058.703367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.521266] env[65630]: INFO networking_nsxv3.common.synchronization [req-dbf27ab2-45cd-48ae-9c61-7f2b9084d727 req-d3a0cd31-4854-4fd5-bf99-a64e8c7c82fe tempest-MigrationsAdminTest-1222576144 tempest-MigrationsAdminTest-1222576144-project-member] Enqueued Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 1059.521936] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 with Priority: HIGHEST for action security_group_members [ 1059.521936] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.521936] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.522254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.522382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.522565] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.522648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.522717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.522868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.522949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.523064] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c09c32-a206-4c5b-9a2a-99cacfd18ac7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.025305] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.025711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.025874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.026196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.026196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.026410] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.026500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.026565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.026717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.026791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.026872] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 is going to be updated. [ 1060.058208] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.058377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.058377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.058584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.058726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.069249] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: IN_PROGRESS for 2s [ 1060.151778] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 1060.152091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.152280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.152494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.152690] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.152809] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.152875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.153037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.153118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.153202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.153329] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.655982] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.656245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.656343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.656652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.656892] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.657052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.657175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.657420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.657667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.657889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.658193] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.659035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.659035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.659035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.659035] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.659035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.660462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.660462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.660462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.660462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.660462] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.163741] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57e44ebf-431f-48ef-9d59-768d3bda2cbd: rpc.has_security_group_logging(os_id): False [ 1061.183880] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.183880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.183880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.183880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.209036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.209036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.209036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.209036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.209818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.209818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.209818] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be updated. [ 1061.286083] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.286083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.286083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.286752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.286959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.308020] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 1062.081924] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 in Status: SUCCESS [ 1062.081924] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c09c32-a206-4c5b-9a2a-99cacfd18ac7 deletion is rescheduled due to dependency. [ 1062.081924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c09c32-a206-4c5b-9a2a-99cacfd18ac7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.152785] env[65630]: INFO networking_nsxv3.common.synchronization [req-1906f481-7931-4787-9077-db0c1bc6a2a5 req-ed2add07-5852-47b7-a580-374b381b8a6e tempest-ServersTestJSON-234048922 tempest-ServersTestJSON-234048922-project-member] Enqueued Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_members [ 1062.152785] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGHEST for action security_group_members [ 1062.155414] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.155414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.155414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.155863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.155863] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.155863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.156079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.157348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.157471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.157578] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.665026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.665026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.665026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.665026] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 is going to be updated. [ 1062.697689] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.697885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.697885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.698142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.698320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.710850] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 in Status: IN_PROGRESS for 2s [ 1063.325914] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 1063.326159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.723250] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 in Status: SUCCESS [ 1064.724052] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 deletion is rescheduled due to dependency. [ 1064.724052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.603755] env[65630]: INFO networking_nsxv3.common.synchronization [req-73226376-3097-4d3a-a522-0f1e20de17b1 req-b1e0740f-41fe-40e4-8dc2-a7deb273ab38 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1065.604722] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1065.606025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.606194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.606235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.606474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.606654] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.606856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.606961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.607177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.607268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.607365] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.088837] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.088837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.088837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.088837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.088837] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.088837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.088837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.088837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.088837] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.089574] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1066.089574] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.089574] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.089574] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.089574] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1066.089574] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.089758] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.109489] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.109734] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1066.109902] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.110094] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.110433] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.110687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.110824] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.111232] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.111484] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eefecc8d-e841-4cf0-9a7d-f46cb2007c94',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.112543] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.112674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.112744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.112920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.113021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.113259] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.113420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.113494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.113642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.113723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.113849] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1066.142130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.142130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.142309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.142469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.142720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.152768] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1066.295535] env[65630]: INFO networking_nsxv3.common.synchronization [req-527b399c-afdb-4a9b-8d58-08b6faa0cb41 req-6bc621b8-1347-4f43-b9b0-6720082cdaf6 tempest-AttachVolumeTestJSON-2085932679 tempest-AttachVolumeTestJSON-2085932679-project-member] Enqueued Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_members [ 1066.296350] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGHEST for action security_group_members [ 1066.296706] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.296831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.296892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.297483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.297483] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.297483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.297483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.297732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.297732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.298420] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.340969] env[65630]: INFO networking_nsxv3.common.synchronization [None req-dd5096e8-5720-4806-9953-f02c23479d63 None None] Enqueued Resource ID: 8052bdfa-1c4e-4fdf-ad3c-02971249fd79 with Priority: HIGHEST for action port [ 1066.341595] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8052bdfa-1c4e-4fdf-ad3c-02971249fd79 with Priority: HIGHEST for action port [ 1066.341917] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-8052bdfa-1c4e-4fdf-ad3c-02971249fd79 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.342060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8052bdfa-1c4e-4fdf-ad3c-02971249fd79" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.342130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8052bdfa-1c4e-4fdf-ad3c-02971249fd79" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.342406] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8052bdfa-1c4e-4fdf-ad3c-02971249fd79" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.342463] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8052bdfa-1c4e-4fdf-ad3c-02971249fd79',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.616205] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.616453] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.617380] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.617380] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.617380] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.617380] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port eefecc8d-e841-4cf0-9a7d-f46cb2007c94 not found, creating... [ 1066.617581] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.617655] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.617861] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.618540] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.618540] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.618642] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.618745] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.618862] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.619322] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.619486] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.619632] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: eefecc8d-e841-4cf0-9a7d-f46cb2007c94 is going to be created. [ 1066.645293] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.645496] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.645496] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.645814] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.645999] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.646382] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.668532] env[65630]: INFO networking_nsxv3.common.synchronization [req-1524d841-0ffd-48bd-b1ad-2af9f2e00cf3 req-72cfa230-d831-4d6d-9bd9-fd9e59274073 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1066.669594] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1066.669594] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.669792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.669792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.670019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.670106] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.670315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.670605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.670605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.670734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.670734] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.801717] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.801886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.802053] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.802191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.802287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.802507] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.802594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.802661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.802830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.802830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.803041] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc is going to be updated. [ 1066.844035] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.844035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.844035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.844317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.844426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.846161] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8052bdfa-1c4e-4fdf-ad3c-02971249fd79 [ 1066.846161] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.846850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.846850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.846850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.846850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.846850] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8052bdfa-1c4e-4fdf-ad3c-02971249fd79 already deleted. [ 1066.847047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8052bdfa-1c4e-4fdf-ad3c-02971249fd79" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.859579] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02aca142-9077-46f6-b85d-5cad6c950dcc in Status: IN_PROGRESS for 2s [ 1067.174021] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.174021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.174021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.174021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.174021] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.174638] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.174638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.174638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.174638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.174792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.174838] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be updated. [ 1067.205855] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.206060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.206103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.206289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.206426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.218666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: IN_PROGRESS for 2s [ 1067.363697] env[65630]: INFO networking_nsxv3.common.synchronization [None req-9eb7e4e2-c4d9-4f32-ae70-2e7408325cfd tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_rules [ 1067.364514] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_rules [ 1067.364868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.365009] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.365083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.365354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.365440] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.441366] env[65630]: INFO networking_nsxv3.common.synchronization [req-73226376-3097-4d3a-a522-0f1e20de17b1 req-1a6972b0-b34e-44ef-8bff-b27164d6dc97 service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 1067.441563] env[65630]: INFO networking_nsxv3.common.synchronization [req-73226376-3097-4d3a-a522-0f1e20de17b1 req-1a6972b0-b34e-44ef-8bff-b27164d6dc97 service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1067.442174] env[65630]: INFO networking_nsxv3.common.synchronization [req-73226376-3097-4d3a-a522-0f1e20de17b1 req-1a6972b0-b34e-44ef-8bff-b27164d6dc97 service nova] Enqueued Resource ID: eefecc8d-e841-4cf0-9a7d-f46cb2007c94 with Priority: HIGHEST for action port [ 1067.442767] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 1067.442916] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1067.443089] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eefecc8d-e841-4cf0-9a7d-f46cb2007c94 with Priority: HIGHEST for action port [ 1067.443402] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.443549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.443620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.443834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.443916] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.444928] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.445049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.445318] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.445427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.446525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.448749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.448749] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eefecc8d-e841-4cf0-9a7d-f46cb2007c94',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.570916] env[65630]: INFO networking_nsxv3.common.synchronization [None req-694c1b49-fb81-444c-9f4b-6de8e2135999 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_rules [ 1067.571939] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_rules [ 1067.572314] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.572314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.890622] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.890763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.890836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.891206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.891313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.892622] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 already deleted. [ 1067.892622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.892622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.892622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.892622] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.951488] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.951692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.951841] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eefecc8d-e841-4cf0-9a7d-f46cb2007c94 with status ACTIVE [ 1067.952141] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.952259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.952328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.952547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.952642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.952821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.952922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.953025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.953275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.953378] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.953619] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.953718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.953781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.953926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.954010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.954098] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eefecc8d-e841-4cf0-9a7d-f46cb2007c94 is going to be updated. [ 1067.979180] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.979791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.980256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.980603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.981533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.981533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eefecc8d-e841-4cf0-9a7d-f46cb2007c94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.153483] env[65630]: INFO networking_nsxv3.common.synchronization [req-bae5a944-98f2-459a-99ae-915844670ff3 req-a8cd865f-50d5-4bb3-be89-0b58c4754300 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1068.156057] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1068.156633] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.156633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.156763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.157310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.157310] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.157310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.157310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.157545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.157545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.157672] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.170714] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1068.170714] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 1068.170714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.170714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.170952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.171099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.171215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.171278] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.171459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.171540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.171633] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.416961] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.417407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.417407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.417557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.417557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.417632] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 already deleted. [ 1068.417920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.514737] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.514916] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.515325] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.515325] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.515576] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.515738] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.515848] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.516506] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.516718] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.516942] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.517063] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.517171] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.517276] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.517380] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.517482] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.517632] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.539069] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.539317] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.539498] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.539687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.540112] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-c019cf76-f7ab-4b5a-9da4-7554321d7576 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.540311] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.540450] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.540788] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.540932] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c019cf76-f7ab-4b5a-9da4-7554321d7576',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.660619] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.673838] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.873340] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02aca142-9077-46f6-b85d-5cad6c950dcc in Status: SUCCESS [ 1068.873610] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc deletion is rescheduled due to dependency. [ 1068.873704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.017963] env[65630]: INFO networking_nsxv3.common.synchronization [None req-18f3b3c1-55f0-4767-add3-aab975a0a3e6 None None] Enqueued Resource ID: aed04fbd-5bf8-46aa-a130-230fa96e3bdf with Priority: HIGHEST for action port [ 1069.018627] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed04fbd-5bf8-46aa-a130-230fa96e3bdf with Priority: HIGHEST for action port [ 1069.019125] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed04fbd-5bf8-46aa-a130-230fa96e3bdf taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.019295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed04fbd-5bf8-46aa-a130-230fa96e3bdf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.019386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed04fbd-5bf8-46aa-a130-230fa96e3bdf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.019668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed04fbd-5bf8-46aa-a130-230fa96e3bdf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.019789] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed04fbd-5bf8-46aa-a130-230fa96e3bdf',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.047687] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.047687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.047687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.047687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.047687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.047687] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port c019cf76-f7ab-4b5a-9da4-7554321d7576 not found, creating... [ 1069.047687] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.047687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.047687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.049265] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.049457] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.050159] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.050442] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.051129] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.051129] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.051491] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.051670] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: c019cf76-f7ab-4b5a-9da4-7554321d7576 is going to be created. [ 1069.074576] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.074912] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.075238] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.075561] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.075814] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.076122] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.163504] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.178436] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.231265] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: SUCCESS [ 1069.231597] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 deletion is rescheduled due to dependency. [ 1069.231810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.524698] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aed04fbd-5bf8-46aa-a130-230fa96e3bdf [ 1069.525051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.526098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.526098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.526388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.526601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.526690] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aed04fbd-5bf8-46aa-a130-230fa96e3bdf already deleted. [ 1069.526897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed04fbd-5bf8-46aa-a130-230fa96e3bdf" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.667243] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.667497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.667573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.667861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.667965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.668091] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1069.681619] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.681856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.681966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.682239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.682366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.682493] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1069.702743] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.702933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.702933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.703176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.703324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.713121] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1069.715623] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.715721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.715788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.716018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.716163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.724507] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1069.806765] env[65630]: INFO networking_nsxv3.common.synchronization [req-bae5a944-98f2-459a-99ae-915844670ff3 req-66e1b9b1-7254-4e5d-b46e-d176690b9aaa service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1069.807037] env[65630]: INFO networking_nsxv3.common.synchronization [req-bae5a944-98f2-459a-99ae-915844670ff3 req-66e1b9b1-7254-4e5d-b46e-d176690b9aaa service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1069.807182] env[65630]: INFO networking_nsxv3.common.synchronization [req-bae5a944-98f2-459a-99ae-915844670ff3 req-66e1b9b1-7254-4e5d-b46e-d176690b9aaa service nova] Enqueued Resource ID: c019cf76-f7ab-4b5a-9da4-7554321d7576 with Priority: HIGHEST for action port [ 1069.807742] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1069.807907] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1069.808048] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c019cf76-f7ab-4b5a-9da4-7554321d7576 with Priority: HIGHEST for action port [ 1069.808383] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.808511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.808588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.808805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.808907] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.810451] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.810552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.810794] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c019cf76-f7ab-4b5a-9da4-7554321d7576 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.810903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.811020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.811196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.811276] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c019cf76-f7ab-4b5a-9da4-7554321d7576',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.313712] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.313900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.314400] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c019cf76-f7ab-4b5a-9da4-7554321d7576 with status ACTIVE [ 1070.314400] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.314400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.314720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.314720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.314837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.314944] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.315180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.315180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.315273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.315363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.315514] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.315630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.315673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.315890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.315890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.315980] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c019cf76-f7ab-4b5a-9da4-7554321d7576 is going to be updated. [ 1070.343385] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.347120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.347120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.347120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.347120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.347120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c019cf76-f7ab-4b5a-9da4-7554321d7576" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.724192] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1071.724585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.724585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.724756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.724948] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.725079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.725147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.725543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.725543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.725543] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.742984] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1071.743218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.743375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.743676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.743876] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.743991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.744069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.744228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.744307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.744392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.744508] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.228250] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.247573] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.247573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.247573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.247573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.247573] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.247995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.247995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.247995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.247995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.248231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.248231] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.248307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.248338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.248479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.248622] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.248712] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.248767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.248907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.248987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.249079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.249166] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.731996] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.752230] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14b62121-4e0b-44ce-9aab-8ed6b4024ea4: rpc.has_security_group_logging(os_id): False [ 1072.773034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.773255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.773255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.773532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.773633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.773975] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.774109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.774167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.774441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.774551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.775096] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.775096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.775096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.775266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.775266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.775482] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.775627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.775730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.775951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.776049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.776357] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1072.845695] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.845893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.846048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.847036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.847036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.861721] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1073.028653] env[65630]: INFO networking_nsxv3.common.synchronization [req-19100e87-22a2-4049-a421-0995b29739fd req-ed5c1109-42f0-4f44-ba59-3a56dbd16141 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1073.029393] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1073.029878] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.029878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.029981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.030633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.030798] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.030903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.031085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.031136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.031227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.031321] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.234058] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.234058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.234298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.234680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.234680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.234680] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1073.264908] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.265103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.265169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.265389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.265565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.274923] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1073.534066] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.534261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.534327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.534498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.534593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.534835] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.534943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.535013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.535179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.535256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.535343] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1073.563376] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.563609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.563739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.563965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.564131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.577016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1074.893170] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1074.893714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.286355] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 4s [ 1075.630751] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1075.630751] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1075.630751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.527090] env[65630]: INFO networking_nsxv3.common.synchronization [req-7728c255-6111-425b-a230-29da120d4d6f req-2b647b00-5d3a-4297-9573-b7dd9e125346 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1076.528208] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1076.528208] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.528208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.528208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.528208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.528526] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.528526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.528526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.528658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.528737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.528826] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.031032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.031696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.031696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.031696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.031859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.032108] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.032250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.032340] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.032540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.032692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.032976] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1077.061094] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.061259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.061328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.061547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.061697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.073891] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1077.296359] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1077.296507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.296641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.297066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.297361] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.297449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.297449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.297961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.297961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.297961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.297961] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.666922] env[65630]: INFO networking_nsxv3.common.synchronization [req-cc36ce77-f14f-4364-bdb2-e09c90c0df36 req-e8dedc88-74fd-44cc-95d0-7e30bf3e396f tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 1077.667501] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 1077.667808] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.669833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.671032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.671032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.671032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.671032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.671032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.672032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.672361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.672500] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.800649] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.800833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.800905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.801155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.801336] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.804888] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.804888] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.804888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.804888] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.177432] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.306195] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d84857eb-b557-4aa2-8d62-34137b9cab1f: rpc.has_security_group_logging(os_id): False [ 1078.324859] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.325051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.325139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.325373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.325478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.325720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.325828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.325923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.326091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.326192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.326449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.326534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.326580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.326757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.326851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.327284] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.327487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.327619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.327827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.327972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.328138] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1078.396865] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.397032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.397106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.397320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.397470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.410670] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1078.571941] env[65630]: INFO networking_nsxv3.common.synchronization [req-37dbb78f-f82a-4770-aaf2-aef1f6debd26 req-7f612d07-11b8-46f7-a35d-097abff1f137 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_members [ 1078.576613] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGHEST for action security_group_members [ 1078.577183] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.577459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.577593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.577915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.578188] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.578360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.578477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.578752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.578942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.579184] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.679809] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.083791] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.084095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.084388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.084900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.086243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.086243] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.086243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.086243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.086243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.086243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.086519] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f is going to be updated. [ 1079.088544] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1079.088702] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 deletion is rescheduled due to dependency. [ 1079.088800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.116926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.117261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.117475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.117749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.117952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.127231] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d95e012-be49-40d8-aebd-6518bae0677f in Status: IN_PROGRESS for 2s [ 1079.185186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.185186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.185186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.185186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.185186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.185186] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be updated. [ 1079.216358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.216510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.216587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.216771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.218018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.227941] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 1080.426128] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1080.426508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.137316] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d95e012-be49-40d8-aebd-6518bae0677f in Status: SUCCESS [ 1081.137488] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f deletion is rescheduled due to dependency. [ 1081.137624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.239798] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 1081.239798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.192591] env[65630]: INFO networking_nsxv3.common.synchronization [None req-7a7864b1-65d5-4495-9c4a-cdebea0ea05d None None] Enqueued Resource ID: e5c4d0de-3a16-4e44-a14c-9e4936829a5b with Priority: HIGHEST for action port [ 1083.193190] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c4d0de-3a16-4e44-a14c-9e4936829a5b with Priority: HIGHEST for action port [ 1083.196220] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5c4d0de-3a16-4e44-a14c-9e4936829a5b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.196220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5c4d0de-3a16-4e44-a14c-9e4936829a5b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.196220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5c4d0de-3a16-4e44-a14c-9e4936829a5b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.196220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5c4d0de-3a16-4e44-a14c-9e4936829a5b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.196220] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c4d0de-3a16-4e44-a14c-9e4936829a5b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.701711] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5c4d0de-3a16-4e44-a14c-9e4936829a5b [ 1083.702392] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.702392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.702392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.702392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.702680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.702680] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5c4d0de-3a16-4e44-a14c-9e4936829a5b already deleted. [ 1083.702680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5c4d0de-3a16-4e44-a14c-9e4936829a5b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.572749] env[65630]: INFO networking_nsxv3.common.synchronization [req-36c999ac-7b54-4ce6-9ac4-fbc8ebbb8768 req-d5359353-b9bf-4012-a847-979d86c24c9a tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1084.573324] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1084.573633] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.574214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.574290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.574493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.574653] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.574772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.574837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.575279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.575279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.575279] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.009032] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.009447] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.009712] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.010065] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.010515] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.010764] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.010931] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.011259] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.011434] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.011742] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.011968] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.012128] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.012298] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.012443] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.012598] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.012762] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.077051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.077220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.077429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.077488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.077750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.077750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.078449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.079454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.079454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.079454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.079679] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1085.142867] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.143348] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.130 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.143765] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.143891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.144475] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-519e42fa-ff9f-42fa-b1b2-fc486646f776 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.145461] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.145461] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.145531] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.145860] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('519e42fa-ff9f-42fa-b1b2-fc486646f776',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.182901] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.183097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.183286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.183505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.183559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.216340] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1085.649668] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.649973] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.650155] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.650723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.650723] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.650964] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 519e42fa-ff9f-42fa-b1b2-fc486646f776 not found, creating... [ 1085.651099] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.651262] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.651379] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.651622] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.651773] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.652084] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.652243] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.652359] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.652629] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.652772] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.652953] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 519e42fa-ff9f-42fa-b1b2-fc486646f776 is going to be created. [ 1085.699646] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.700830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.700830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.700830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.700830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.700830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.811874] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b4322873-5dee-499a-a4d3-37fb268531ec None None] Enqueued Resource ID: 4c65bf62-8916-4732-9494-acc8ddc93c77 with Priority: HIGHEST for action port [ 1085.812468] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c65bf62-8916-4732-9494-acc8ddc93c77 with Priority: HIGHEST for action port [ 1085.812784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c65bf62-8916-4732-9494-acc8ddc93c77 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.812911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c65bf62-8916-4732-9494-acc8ddc93c77" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.812971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c65bf62-8916-4732-9494-acc8ddc93c77" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.813244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c65bf62-8916-4732-9494-acc8ddc93c77" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.813329] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c65bf62-8916-4732-9494-acc8ddc93c77',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.089467] env[65630]: INFO networking_nsxv3.common.synchronization [None req-cfe68055-cdd6-4e57-987b-71fcbeee37fd tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_rules [ 1086.090040] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_rules [ 1086.090354] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.090482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.090548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.090807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.090891] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.193910] env[65630]: INFO networking_nsxv3.common.synchronization [None req-c8f8bdce-399f-4a38-933d-7dad51b61197 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_rules [ 1086.194147] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_rules [ 1086.194457] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.194592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.278022] env[65630]: INFO networking_nsxv3.common.synchronization [req-36c999ac-7b54-4ce6-9ac4-fbc8ebbb8768 req-f5086e12-77fd-4f8e-b37e-9bb7e601d3cd service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1086.278022] env[65630]: INFO networking_nsxv3.common.synchronization [req-36c999ac-7b54-4ce6-9ac4-fbc8ebbb8768 req-f5086e12-77fd-4f8e-b37e-9bb7e601d3cd service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1086.278022] env[65630]: INFO networking_nsxv3.common.synchronization [req-36c999ac-7b54-4ce6-9ac4-fbc8ebbb8768 req-f5086e12-77fd-4f8e-b37e-9bb7e601d3cd service nova] Enqueued Resource ID: 519e42fa-ff9f-42fa-b1b2-fc486646f776 with Priority: HIGHEST for action port [ 1086.278022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1086.278022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1086.278022] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 519e42fa-ff9f-42fa-b1b2-fc486646f776 with Priority: HIGHEST for action port [ 1086.278022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.278022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.278022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.278777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.278982] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.282107] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.282107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.282107] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-519e42fa-ff9f-42fa-b1b2-fc486646f776 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.282107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.282107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.282107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.282107] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('519e42fa-ff9f-42fa-b1b2-fc486646f776',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.318030] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c65bf62-8916-4732-9494-acc8ddc93c77 [ 1086.318030] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.318030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.318030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.318030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.318030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.318030] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c65bf62-8916-4732-9494-acc8ddc93c77 already deleted. [ 1086.318030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c65bf62-8916-4732-9494-acc8ddc93c77" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.613480] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.613480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.613480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.613480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.613480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.613480] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 already deleted. [ 1086.613480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.613480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.613480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.613480] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.782517] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.782795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.782857] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 519e42fa-ff9f-42fa-b1b2-fc486646f776 with status ACTIVE [ 1086.783074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.783211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.783211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.783434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.783504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783694] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.783848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.783920] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.784097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.784177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.784361] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.784468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.784529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.784642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.784779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.784871] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 519e42fa-ff9f-42fa-b1b2-fc486646f776 is going to be updated. [ 1086.811264] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.811442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.811511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.811689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.811830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.811996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-519e42fa-ff9f-42fa-b1b2-fc486646f776" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.930560] env[65630]: INFO networking_nsxv3.common.synchronization [req-c757e0ba-5ca3-4082-a7cc-6db5fff348ae req-96b81947-8cc2-4c73-8544-b7b4fded8e5b tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_members [ 1086.931292] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_members [ 1086.931657] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.931811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.931971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.932248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.932413] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.932516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.932886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.932886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.932886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.932886] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.138687] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.138851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.138930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.139480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.139480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.139480] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 already deleted. [ 1087.139672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.227581] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1087.227581] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 deletion is rescheduled due to dependency. [ 1087.227581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.227791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.228079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.229654] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.229654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.229654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.229654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.229654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.230223] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.280637] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.280840] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.280964] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.281308] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.281570] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.282146] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.282403] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.282530] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.282676] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.282882] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.283021] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.283107] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.283210] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.283317] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.283418] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.283548] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.307801] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.307896] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.307964] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.308193] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.308633] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-c74a3552-b826-47b0-bc0b-955f92b8c399 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.308948] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.309134] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.309488] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.309908] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c74a3552-b826-47b0-bc0b-955f92b8c399',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.435380] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.435557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.435632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.435860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.435961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.436175] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.436279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.436329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.436484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.436561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.436647] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 already deleted. [ 1087.436729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.733527] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.811775] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.812139] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.812198] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.812480] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.812618] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.812798] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port c74a3552-b826-47b0-bc0b-955f92b8c399 not found, creating... [ 1087.813117] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.813307] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.813444] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.813673] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.813914] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.814224] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.814382] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.814498] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.814771] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.815113] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.815286] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: c74a3552-b826-47b0-bc0b-955f92b8c399 is going to be created. [ 1087.838113] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.838306] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.838433] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.838699] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.838920] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.839228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.236432] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.306605] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.306605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.306605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.306605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.306943] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.597504] env[65630]: INFO networking_nsxv3.common.synchronization [req-c757e0ba-5ca3-4082-a7cc-6db5fff348ae req-ab80c2bf-33cf-41d5-afa4-9da4f8b857c0 service nova] Enqueued Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_rules [ 1088.598221] env[65630]: INFO networking_nsxv3.common.synchronization [req-c757e0ba-5ca3-4082-a7cc-6db5fff348ae req-ab80c2bf-33cf-41d5-afa4-9da4f8b857c0 service nova] Enqueued Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_members [ 1088.598477] env[65630]: INFO networking_nsxv3.common.synchronization [req-c757e0ba-5ca3-4082-a7cc-6db5fff348ae req-ab80c2bf-33cf-41d5-afa4-9da4f8b857c0 service nova] Enqueued Resource ID: c74a3552-b826-47b0-bc0b-955f92b8c399 with Priority: HIGHEST for action port [ 1088.599081] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_rules [ 1088.599315] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_members [ 1088.599315] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c74a3552-b826-47b0-bc0b-955f92b8c399 with Priority: HIGHEST for action port [ 1088.599605] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.599714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.599788] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.600184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.600269] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.601216] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.601325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.601383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.601562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.601842] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.601974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.602056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.602222] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.602311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.602472] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.603866] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c74a3552-b826-47b0-bc0b-955f92b8c399 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.603866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.604058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.604386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.604452] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c74a3552-b826-47b0-bc0b-955f92b8c399',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.738495] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.738656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.738715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.739247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.739247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.739247] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1088.784461] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.784642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.784688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.784924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.785086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.799546] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1088.813115] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.106821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.107160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.107629] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.109016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c74a3552-b826-47b0-bc0b-955f92b8c399 with status ACTIVE [ 1089.109339] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.109548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.109548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.109888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.109888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.110028] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.110110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.110185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.110480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.110480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.112659] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.112659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.112659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.112659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.112659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.112659] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c74a3552-b826-47b0-bc0b-955f92b8c399 is going to be updated. [ 1089.139825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.140121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.140121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.140342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.140485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.140657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c74a3552-b826-47b0-bc0b-955f92b8c399" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.315919] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.450228] env[65630]: INFO networking_nsxv3.common.synchronization [req-9204132e-60bc-4d3c-9461-f9ebdec87a8d req-734c090d-dc35-44d7-b362-e53d46140779 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1089.450228] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1089.450434] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.452737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.453078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.453480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.453905] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.454205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.454439] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.454896] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.455212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.456747] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.616041] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.818209] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1089.818477] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1089.862070] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.862521] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.863833] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.863833] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.863833] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.864221] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.864550] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.864998] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.865425] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.865924] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.866290] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.868257] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.868257] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.868257] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.868257] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.868257] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.901289] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.901661] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.901895] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.902190] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.903061] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-e8cb8a26-389f-471b-aca8-cd12bb551aaa taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.903483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.903548] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.905054] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.905054] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8cb8a26-389f-471b-aca8-cd12bb551aaa',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.958756] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.958994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.959129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.959501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.959654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.960043] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.960230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.960541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.960876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.961092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.961274] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1090.006038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.006038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.006326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.006368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.006488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.029845] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1090.119879] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.120085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.120181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.120447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.120571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.120637] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 is going to be created. [ 1090.170061] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.170314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.170314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.170498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.170651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.185481] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 in Status: UNINITIALIZED for 2s [ 1090.407688] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.408026] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.408172] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.408473] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.408624] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.408782] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port e8cb8a26-389f-471b-aca8-cd12bb551aaa not found, creating... [ 1090.409200] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.409458] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.409627] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.409947] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.410173] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.410598] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.411087] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.411087] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.411324] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.411454] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.411697] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: e8cb8a26-389f-471b-aca8-cd12bb551aaa is going to be created. [ 1090.432272] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.432502] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.432604] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.432876] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.433112] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.433332] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.810260] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1090.810495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.810759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.811041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.811247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.811370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.811442] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.811649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.811701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.811751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.811970] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.978856] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.979276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.979276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.979563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.994593] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1090.995604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.996952] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1091.052472] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.052622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.052690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.052911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.065239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.065956] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1091.066052] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1091.066155] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1091.114135] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.114303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.114376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.114595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.116637] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.116637] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1091.182876] env[65630]: INFO networking_nsxv3.common.synchronization [req-9204132e-60bc-4d3c-9461-f9ebdec87a8d req-cfc39753-d827-4439-ba7f-dcd961cd29f0 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1091.182876] env[65630]: INFO networking_nsxv3.common.synchronization [req-9204132e-60bc-4d3c-9461-f9ebdec87a8d req-cfc39753-d827-4439-ba7f-dcd961cd29f0 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1091.183613] env[65630]: INFO networking_nsxv3.common.synchronization [req-9204132e-60bc-4d3c-9461-f9ebdec87a8d req-cfc39753-d827-4439-ba7f-dcd961cd29f0 service nova] Enqueued Resource ID: e8cb8a26-389f-471b-aca8-cd12bb551aaa with Priority: HIGHEST for action port [ 1091.183613] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1091.185581] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1091.185581] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8cb8a26-389f-471b-aca8-cd12bb551aaa with Priority: HIGHEST for action port [ 1091.185581] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.185581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.185581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.185581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.185581] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.186080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.186080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.187032] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8cb8a26-389f-471b-aca8-cd12bb551aaa taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.187032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.187032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.187032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.187032] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8cb8a26-389f-471b-aca8-cd12bb551aaa',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.211555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.211768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.211849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.212081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.212375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.212664] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1091.288395] env[65630]: INFO networking_nsxv3.common.synchronization [None req-2b9b27c7-e1af-46c5-9b37-4f7850420e6e tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1091.288920] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1091.289277] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.289638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.289638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.289638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.289839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.289948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.290411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.290586] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.290677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.290983] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.313455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.313603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.313667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.313907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.314213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.314523] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1091.314654] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6', '397b25ae-6929-46ce-8711-37502e4943b3', '606afe18-cfb7-4b98-9fd4-530a5517abc9', 'e3541bfc-04c2-4eba-9579-7dda3fc0388c', '59e543f5-3a08-4982-8918-ea2593f725ef', '0aff3db7-d7a7-4b84-8908-260cd4cfa00e', 'd49103b2-0d3b-4f56-8ce6-a2ba4306895c', '044f1395-427c-4906-bf47-71c561e2457d', '8d95e012-be49-40d8-aebd-6518bae0677f', '6dbe819a-cf2f-494c-95fc-b507ea47e6d1', '022a54ae-7f58-4ca4-ad58-e1f8c8343cd1', '129b80e0-f31c-48f3-b8cb-02ada0d90df9', '02aca142-9077-46f6-b85d-5cad6c950dcc', '201b4cc2-0baa-4c4b-b457-1bb173e25095', '91afb2d7-9d0e-478b-8507-d9b2e72ee7a3', '1b6e41ae-02b7-4285-8dd1-1d78634488b5', '5a73db6d-e930-47a9-9dbe-748ef759f251', '283b63f2-dcb7-43d1-8f8b-ceaa21132d6d', '55cab18d-dd48-49fe-b38f-0e7e827f237c', 'f2ce74e6-0ec2-49a0-a447-71132c9e529b', '6a30c8a0-56ed-49c0-9575-ac779408f52f', '0e647f36-5543-4052-8cd2-b972c5bc69c3', '8a871646-acc8-47a5-a5e8-6672ff7eb295', '00ac0e45-8fb0-4a0b-aeee-053765768653', 'b71bd905-a59a-420e-96dc-4f48e2b11e86', '250f01a9-6e9d-4438-a22e-10b77875cd34', 'a5d959e5-8b2a-40d2-918d-da1d80daa362', 'd84857eb-b557-4aa2-8d62-34137b9cab1f', '260959d6-44de-432d-a8ee-ce634ff440ed', 'dcabb3c1-63c7-4e6e-99e0-7cb17896f367', 'b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d', '34ac1819-3d29-4b4e-ac83-e39408cd6e49', '313d0c55-f8bb-4559-9f42-dfae7678f0bc', 'e8db9dba-41a6-4390-8a03-e9d1a073b831', '29cd0e69-d83a-4e99-940e-3b95d8bf9b2d', '9ed098d0-aa55-4a88-be4f-3fe063ee74f6', '24ebd7ab-0776-4822-9b99-4e4b98571494', 'd4010c2f-2754-4e2d-949f-ec21a2348a3d', '14b62121-4e0b-44ce-9aab-8ed6b4024ea4', '57e44ebf-431f-48ef-9d59-768d3bda2cbd', '636d8397-05bf-4fff-8f28-4b4ded6b5b5d', '0b25fb6e-f742-4dda-bb8b-ad33a402286e', 'f3c09c32-a206-4c5b-9a2a-99cacfd18ac7', 'bee721e8-67ba-4959-8884-95efeb9d52b8', '6f9d43bc-6007-4e6a-81c6-321db263b170', 'f69e9012-529a-49ae-80ce-87883c1f49fe'} {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1091.314752] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1091.315813] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.315917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.334359] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.334556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.334556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.334773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.334863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.334966] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1091.335066] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1091.335146] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1091.432846] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.433063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.433122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.433288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.434856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.434856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1091.434856] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1091.434856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1091.434856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1091.435100] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1091.435100] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGH for action security_group_rules [ 1091.435160] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGH for action security_group_rules [ 1091.435233] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGH for action security_group_rules [ 1091.435292] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGH for action security_group_rules [ 1091.435355] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGH for action security_group_rules [ 1091.435420] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGH for action security_group_rules [ 1091.435529] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGH for action security_group_rules [ 1091.435602] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGH for action security_group_rules [ 1091.435662] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGH for action security_group_rules [ 1091.435723] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGH for action security_group_rules [ 1091.435785] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGH for action security_group_rules [ 1091.435847] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGH for action security_group_rules [ 1091.435914] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGH for action security_group_rules [ 1091.436061] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGH for action security_group_rules [ 1091.436061] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGH for action security_group_rules [ 1091.436179] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGH for action security_group_rules [ 1091.436179] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGH for action security_group_rules [ 1091.436242] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGH for action security_group_rules [ 1091.436284] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGH for action security_group_rules [ 1091.436318] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGH for action security_group_rules [ 1091.436400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.690316] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.690426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.690619] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8cb8a26-389f-471b-aca8-cd12bb551aaa with status ACTIVE [ 1091.690789] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.690898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.690962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.691222] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.691313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.691487] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.691583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.691644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.691805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.691882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.692070] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.692161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.692230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.692350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.692417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.692496] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8cb8a26-389f-471b-aca8-cd12bb551aaa is going to be updated. [ 1091.729217] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.729801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.729801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.729801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.729801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.730105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8cb8a26-389f-471b-aca8-cd12bb551aaa" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.793566] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.974282] env[65630]: INFO networking_nsxv3.common.synchronization [req-efd5a977-f33b-4dae-82ae-2454161729c3 req-0b43a9fb-2de8-4927-ab90-133a7a45b39c tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1091.974282] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1091.974524] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 with Priority: HIGH for action security_group_rules [ 1091.974563] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 with Priority: HIGH for action security_group_rules [ 1091.975054] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c with Priority: HIGH for action security_group_rules [ 1091.975054] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 with Priority: HIGH for action security_group_rules [ 1091.975054] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b with Priority: HIGH for action security_group_rules [ 1091.975289] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c with Priority: HIGH for action security_group_rules [ 1091.975335] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d with Priority: HIGH for action security_group_rules [ 1091.975379] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 with Priority: HIGH for action security_group_rules [ 1091.975486] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGH for action security_group_rules [ 1091.975693] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 with Priority: HIGH for action security_group_rules [ 1091.975754] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca142-9077-46f6-b85d-5cad6c950dcc with Priority: HIGH for action security_group_rules [ 1091.975792] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 with Priority: HIGH for action security_group_rules [ 1091.975902] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGH for action security_group_rules [ 1091.975992] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 with Priority: HIGH for action security_group_rules [ 1091.976092] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d95e012-be49-40d8-aebd-6518bae0677f with Priority: HIGH for action security_group_rules [ 1091.976179] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e with Priority: HIGH for action security_group_rules [ 1091.976278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044f1395-427c-4906-bf47-71c561e2457d with Priority: HIGH for action security_group_rules [ 1091.976358] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGH for action security_group_rules [ 1091.977100] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGH for action security_group_rules [ 1091.977278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c with Priority: HIGH for action security_group_rules [ 1091.977615] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.977747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.977816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.978043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.978216] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.978321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.978413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.978563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.978616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.978720] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.980320] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.980320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.980732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.980732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.980732] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.981449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606afe18-cfb7-4b98-9fd4-530a5517abc9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.981552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.981608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.981768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.981842] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606afe18-cfb7-4b98-9fd4-530a5517abc9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.982571] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.982679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.982745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.982892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.982963] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d49103b2-0d3b-4f56-8ce6-a2ba4306895c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.983672] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.983776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.983875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.984113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.984196] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91afb2d7-9d0e-478b-8507-d9b2e72ee7a3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.985034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.985195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.985297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.985879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.985879] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ce74e6-0ec2-49a0-a447-71132c9e529b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.986724] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55cab18d-dd48-49fe-b38f-0e7e827f237c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.986838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.986885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.987194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.987534] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55cab18d-dd48-49fe-b38f-0e7e827f237c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.988461] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.988617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.988710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.989054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.989054] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('283b63f2-dcb7-43d1-8f8b-ceaa21132d6d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.989583] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a73db6d-e930-47a9-9dbe-748ef759f251 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.989663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.989810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.989973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.990061] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a73db6d-e930-47a9-9dbe-748ef759f251',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.990805] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.991084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.991160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.991345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.991421] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.992257] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.992381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.992445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.992883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.992883] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b6e41ae-02b7-4285-8dd1-1d78634488b5',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.993595] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02aca142-9077-46f6-b85d-5cad6c950dcc taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.993751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.993844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.994050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.994133] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02aca142-9077-46f6-b85d-5cad6c950dcc',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.995098] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.995098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.995245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.995396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.995482] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('129b80e0-f31c-48f3-b8cb-02ada0d90df9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.996708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.996708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.997136] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.997263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.997332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.997493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.997640] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbe819a-cf2f-494c-95fc-b507ea47e6d1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.998371] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d95e012-be49-40d8-aebd-6518bae0677f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.998499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.998592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.998808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.998891] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d95e012-be49-40d8-aebd-6518bae0677f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.999897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.999897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.999897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.000089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.000089] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0aff3db7-d7a7-4b84-8908-260cd4cfa00e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.000884] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-044f1395-427c-4906-bf47-71c561e2457d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.001052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.001122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.001267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.001500] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('044f1395-427c-4906-bf47-71c561e2457d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.001994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.002207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.002207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.002320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.002924] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.003078] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.003206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.003261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.003388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.003458] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.004299] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.004404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.004469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.004616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.004688] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3541bfc-04c2-4eba-9579-7dda3fc0388c',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.040537] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1092.040946] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 deletion is rescheduled due to dependency. [ 1092.040946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.041060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.041223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.041401] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.041516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.041580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.041750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.041862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.041951] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.197025] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 in Status: SUCCESS [ 1092.197372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.200284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.200284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.200284] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.200284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.200284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.200284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.200284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.200284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.200284] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.296520] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.340557] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.340557] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.340557] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.340557] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.342899] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.343157] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.343269] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.343514] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.343663] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.343913] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.344044] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.344183] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.344314] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.344448] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.344575] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.344717] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.371907] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.372108] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.372341] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.372820] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.373240] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-03be5768-7657-4a63-9b50-2e460e10c1ed taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.373430] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.373552] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.373945] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.374094] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03be5768-7657-4a63-9b50-2e460e10c1ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.508075] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.508236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.508319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.508510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.514989] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.515186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.515186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.515510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.515586] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.515672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.515672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.515865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.515949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.516051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.516155] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.525189] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.525396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.525572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.525706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.526202] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.526363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.526435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.526541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.526626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.526721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.526825] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.550498] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.583601] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.583601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.588527] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.588527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.589838] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.589997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.590898] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.591034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.592236] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.592236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.593263] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.593386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.594181] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.594181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.594900] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.595124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.595726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.597038] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.597038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.597038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.597038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.597038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.597038] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1092.597383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.597562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.599202] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.599313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.600457] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.600583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.602031] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.602145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.602772] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.603233] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.603339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.603955] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.604787] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.604787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.605094] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.605486] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.605589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.606569] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.606960] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.607183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.608325] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.608745] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.608871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.609495] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.609867] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.609960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.623433] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.624075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.624204] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0aff3db7-d7a7-4b84-8908-260cd4cfa00e is going to be deleted. [ 1092.625318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.625538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.628114] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.628316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.628316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.628562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.628706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.640495] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1092.648592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.648781] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02aca142-9077-46f6-b85d-5cad6c950dcc is going to be deleted. [ 1092.649695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.649914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.670464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.670636] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55cab18d-dd48-49fe-b38f-0e7e827f237c is going to be deleted. [ 1092.671604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.671846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.694214] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.694432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.703934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.704213] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91afb2d7-9d0e-478b-8507-d9b2e72ee7a3 is going to be deleted. [ 1092.705201] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.706082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.706317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.726381] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.726562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.727589] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.727717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.731852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.732025] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a73db6d-e930-47a9-9dbe-748ef759f251 is going to be deleted. [ 1092.733241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.733534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.798619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.798810] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 129b80e0-f31c-48f3-b8cb-02ada0d90df9 is going to be deleted. [ 1092.799767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.799992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.801073] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.801199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.801272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.801457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.801544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.801640] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1092.860856] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.861085] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be deleted. [ 1092.862453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.862733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.865320] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.865542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.876816] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.877053] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.877224] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.877720] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.877874] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.878102] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 03be5768-7657-4a63-9b50-2e460e10c1ed not found, creating... [ 1092.878492] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.878694] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.878833] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.879158] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.879371] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.879792] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.880080] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.880230] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.880534] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.880753] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.880965] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 03be5768-7657-4a63-9b50-2e460e10c1ed is going to be created. [ 1092.907424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.907603] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 283b63f2-dcb7-43d1-8f8b-ceaa21132d6d is going to be deleted. [ 1092.908529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.908779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.910575] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.910717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.910892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.910961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.911096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.925468] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.925468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.925748] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.925896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.926158] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.926477] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.946955] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.947183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.954797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1092.959243] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.959542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.966790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.966995] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ce74e6-0ec2-49a0-a447-71132c9e529b is going to be deleted. [ 1092.968208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.968564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.018630] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.018945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.018945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.019052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.019199] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.019359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.019402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.019562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.019661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.019831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.019887] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.019982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.020072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.020239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.020352] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.020447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.020506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.020655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.020726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.020887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.020943] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.039260] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.053139] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.057428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.057687] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d49103b2-0d3b-4f56-8ce6-a2ba4306895c is going to be deleted. [ 1093.059203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.059451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.062980] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.063154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.064890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.065018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.103924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.104227] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbe819a-cf2f-494c-95fc-b507ea47e6d1 is going to be deleted. [ 1093.106400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.106400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.110466] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.110781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.172889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.172889] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606afe18-cfb7-4b98-9fd4-530a5517abc9 is going to be deleted. [ 1093.173676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.173854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.208481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.208654] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d95e012-be49-40d8-aebd-6518bae0677f is going to be deleted. [ 1093.210097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.210097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.210954] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b88cc7d-8b33-4bc2-ab6f-d06d46602783: rpc.has_security_group_logging(os_id): False [ 1093.264852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.264852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.267875] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.267875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.269685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.269809] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6 is going to be deleted. [ 1093.270827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.271013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.293462] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.293462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.303428] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.303428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.368970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.368970] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 044f1395-427c-4906-bf47-71c561e2457d is going to be deleted. [ 1093.369297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.370216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.394309] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.394309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.403861] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.403861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.445452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.445452] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b6e41ae-02b7-4285-8dd1-1d78634488b5 is going to be deleted. [ 1093.446485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.446485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.503026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.503026] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3541bfc-04c2-4eba-9579-7dda3fc0388c is going to be deleted. [ 1093.503026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.503026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.503026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.503502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0aff3db7-d7a7-4b84-8908-260cd4cfa00e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.504022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.504318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.504544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.504847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55cab18d-dd48-49fe-b38f-0e7e827f237c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.505570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.505960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.506219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.506479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02aca142-9077-46f6-b85d-5cad6c950dcc" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.506768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.507065] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.507253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.507489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91afb2d7-9d0e-478b-8507-d9b2e72ee7a3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.507782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a73db6d-e930-47a9-9dbe-748ef759f251" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-129b80e0-f31c-48f3-b8cb-02ada0d90df9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-283b63f2-dcb7-43d1-8f8b-ceaa21132d6d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ce74e6-0ec2-49a0-a447-71132c9e529b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.511023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.512587] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.512869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.513073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.513336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.513633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.513893] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 is going to be created. [ 1093.516170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.516170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.516170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.516170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d49103b2-0d3b-4f56-8ce6-a2ba4306895c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.516170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.516170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.516510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.516726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbe819a-cf2f-494c-95fc-b507ea47e6d1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.516989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.517263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.517428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.517640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606afe18-cfb7-4b98-9fd4-530a5517abc9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.517872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.518131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.518323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.518549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d95e012-be49-40d8-aebd-6518bae0677f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.519319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.519651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.519869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.520095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7c99ae-a9b5-4e8f-bbd7-5b395d7249c6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.525146] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59e543f5-3a08-4982-8918-ea2593f725ef: rpc.has_security_group_logging(os_id): False [ 1093.543518] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397b25ae-6929-46ce-8711-37502e4943b3: rpc.has_security_group_logging(os_id): False [ 1093.551572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.551572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.551572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.551572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.551572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.551572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-044f1395-427c-4906-bf47-71c561e2457d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.558345] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.558345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.558345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.558345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.558345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.558345] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1093.591676] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.591676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.591676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.591676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.591676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.591676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b6e41ae-02b7-4285-8dd1-1d78634488b5" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.596863] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.596863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.596863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.596863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.609054] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.609381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.660052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.660052] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.660052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.660052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.660052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.660052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.660052] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.660052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.660052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.660760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.660760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.660760] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.660922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.660922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.661588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.661686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.664184] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be updated. [ 1093.664184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.664184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.667074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.667268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.667595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.667749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.667877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.688247] env[65630]: INFO networking_nsxv3.common.synchronization [req-efd5a977-f33b-4dae-82ae-2454161729c3 req-429b6281-8786-460d-9ad2-d4093cb8d9b3 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1093.688491] env[65630]: INFO networking_nsxv3.common.synchronization [req-efd5a977-f33b-4dae-82ae-2454161729c3 req-429b6281-8786-460d-9ad2-d4093cb8d9b3 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1093.688641] env[65630]: INFO networking_nsxv3.common.synchronization [req-efd5a977-f33b-4dae-82ae-2454161729c3 req-429b6281-8786-460d-9ad2-d4093cb8d9b3 service nova] Enqueued Resource ID: 03be5768-7657-4a63-9b50-2e460e10c1ed with Priority: HIGHEST for action port [ 1093.689362] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1093.689513] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1093.689612] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03be5768-7657-4a63-9b50-2e460e10c1ed with Priority: HIGHEST for action port [ 1093.689917] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.690055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.690129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.690367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.690474] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.691433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.692074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.692641] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-03be5768-7657-4a63-9b50-2e460e10c1ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.692641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.692641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.692810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.692810] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03be5768-7657-4a63-9b50-2e460e10c1ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.704070] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1093.748565] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.749276] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.749585] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.749920] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.750294] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.750499] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.750600] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.751014] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.751014] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.751211] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.751410] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.751488] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.751616] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.751699] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.751844] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.752030] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.756573] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.756903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.766510] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.766680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.782676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.783361] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.783361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.783477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.783667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.783890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.783969] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1093.785180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.785455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.785524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.785628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3541bfc-04c2-4eba-9579-7dda3fc0388c" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.786181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.786181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.786392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.798153] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.798153] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1093.798153] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.798153] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.798480] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-b454d4b4-47b5-4521-9a09-26f937987ecd taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.798480] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.798597] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.798886] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.799037] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b454d4b4-47b5-4521-9a09-26f937987ecd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.822856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 in Status: IN_PROGRESS for 2s [ 1093.956183] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.956377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.956422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.956620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.956757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.959074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.959229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.959275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.959458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.959589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.986681] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 1094.001919] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1094.002376] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1094.196680] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.196968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.197071] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03be5768-7657-4a63-9b50-2e460e10c1ed with status ACTIVE [ 1094.197228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.197338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.197403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.197623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.197713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.197887] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.197986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.198065] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.198223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.198293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.198501] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.198623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.198623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.198759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.198832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.198919] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03be5768-7657-4a63-9b50-2e460e10c1ed is going to be updated. [ 1094.220554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.220704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.220770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.220984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.221141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.221294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03be5768-7657-4a63-9b50-2e460e10c1ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.229757] env[65630]: INFO networking_nsxv3.common.synchronization [req-97b5868c-068a-4e7d-bb2c-b8e7e5a77a69 req-4f505273-0506-44e0-bd17-c5ffd45f666c tempest-ServersTestManualDisk-1045302247 tempest-ServersTestManualDisk-1045302247-project-member] Enqueued Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_members [ 1094.230500] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 with Priority: HIGHEST for action security_group_members [ 1094.230896] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-24ebd7ab-0776-4822-9b99-4e4b98571494 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.231082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.231197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.231456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.231675] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.231900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.232027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.232259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.232401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.232554] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24ebd7ab-0776-4822-9b99-4e4b98571494',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.301744] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.302107] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.302286] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.302660] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.302857] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.303126] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port b454d4b4-47b5-4521-9a09-26f937987ecd not found, creating... [ 1094.303508] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.303903] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.304118] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.304435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.304648] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.305060] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.305285] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.305499] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.305791] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.306031] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.306252] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: b454d4b4-47b5-4521-9a09-26f937987ecd is going to be created. [ 1094.359496] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.359933] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.360195] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.360631] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.361041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.361381] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.650997] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1094.651177] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1094.651223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.651365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.651589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.651790] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.651935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.651995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.652174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.652255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.652350] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.735649] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.735649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.735775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.735912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.738753] env[65630]: INFO networking_nsxv3.common.synchronization [req-d162f494-7f34-4896-8a6c-08b33804f1ba req-0829f3bd-7dab-4c01-a8b3-d0b85e2a12e7 tempest-ServersNegativeTestJSON-111815627 tempest-ServersNegativeTestJSON-111815627-project-member] Enqueued Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 1094.739375] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd with Priority: HIGHEST for action security_group_members [ 1094.740069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e44ebf-431f-48ef-9d59-768d3bda2cbd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.740203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.740272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.740463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.740619] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.740717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.740780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.740928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.741035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.741288] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e44ebf-431f-48ef-9d59-768d3bda2cbd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.761559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.761559] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.761559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.761559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.762059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.762059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.762059] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 is going to be updated. [ 1094.790740] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.790890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.790966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.791219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.791429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.801366] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 in Status: IN_PROGRESS for 2s [ 1094.968597] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1094.968597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.968597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.968597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.968597] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.968597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.968597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.969334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.969334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.969334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.969334] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.969334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.969334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.969334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.970613] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.970613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.970613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.970613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.970613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.970613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.970613] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.052742] env[65630]: INFO networking_nsxv3.common.synchronization [req-84274a20-28c1-4c68-a942-7dfd51eb5242 req-175da8cb-2496-4ae1-8b90-87e79e782bd7 service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1095.052742] env[65630]: INFO networking_nsxv3.common.synchronization [req-84274a20-28c1-4c68-a942-7dfd51eb5242 req-175da8cb-2496-4ae1-8b90-87e79e782bd7 service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1095.052742] env[65630]: INFO networking_nsxv3.common.synchronization [req-84274a20-28c1-4c68-a942-7dfd51eb5242 req-175da8cb-2496-4ae1-8b90-87e79e782bd7 service nova] Enqueued Resource ID: b454d4b4-47b5-4521-9a09-26f937987ecd with Priority: HIGHEST for action port [ 1095.052742] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1095.052742] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1095.052967] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b454d4b4-47b5-4521-9a09-26f937987ecd with Priority: HIGHEST for action port [ 1095.053390] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.053499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.053718] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.053817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.053938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.054154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.054303] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.055601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.055601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.055601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.055601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.055601] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.056211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-b454d4b4-47b5-4521-9a09-26f937987ecd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.056308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.056355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.056507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.056579] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b454d4b4-47b5-4521-9a09-26f937987ecd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.157862] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.199635] env[65630]: INFO networking_nsxv3.common.synchronization [req-42c54dae-87da-44b8-8a4c-e9b2c8af5401 req-2bd9d14c-2ddc-46ea-805e-1c637754d874 tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 1095.200320] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 with Priority: HIGHEST for action security_group_members [ 1095.200652] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-34ac1819-3d29-4b4e-ac83-e39408cd6e49 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.200785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.200853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.201106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.201285] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.201421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.201488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.201660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.201765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.201881] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34ac1819-3d29-4b4e-ac83-e39408cd6e49',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.243795] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.243983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.244114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.244367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.265709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.265975] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.266154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.266250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.266384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.266530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.266567] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd is going to be updated. [ 1095.295287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.295747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.295919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.296038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.296193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.306114] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: IN_PROGRESS for 2s [ 1095.472655] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1: rpc.has_security_group_logging(os_id): False [ 1095.492734] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.492734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.492734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.492734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.511271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.511524] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.511656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.511724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.512106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.512207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.512430] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.512532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.512598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.512775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.512860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.513086] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.513181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.513241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.513390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.513466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.513560] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1095.558713] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.559290] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b454d4b4-47b5-4521-9a09-26f937987ecd with status ACTIVE [ 1095.559560] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.559697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.559764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.559969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.560079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.560256] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.560354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.560426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.560581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.560660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.560839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.560933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.560995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.562165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.562507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.562507] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b454d4b4-47b5-4521-9a09-26f937987ecd is going to be updated. [ 1095.601067] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.601260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.601304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.602096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.602096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.602096] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b454d4b4-47b5-4521-9a09-26f937987ecd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.612029] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.612029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.612029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.612029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.612029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.630855] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1095.659995] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.704120] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.704374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.704534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.704796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.776459] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1095.776459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.776459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.776459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.776459] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.776459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.776459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.776459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.776999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.777313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.777630] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.797396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.797396] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.797396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.797396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.799143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.799143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.799143] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 is going to be updated. [ 1095.838939] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 in Status: SUCCESS [ 1095.838939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.840020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.840150] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.840228] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.840451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.840620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.853382] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: IN_PROGRESS for 2s [ 1096.006317] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 1096.006694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.023931] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1096.023931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.065291] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.162569] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.162803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.162906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.163581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.163581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.163581] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1096.199035] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.199229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.199313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.200173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.200173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.210834] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1096.282515] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.282696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.282790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.283013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.283199] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.283300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.283358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.283516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.283606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.283698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.283845] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.283970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.284059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.284209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.284350] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.284444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.284503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.284642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.284744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.284831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.284926] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.569209] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.569389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.569389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.569599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.569707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.569798] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1096.604244] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.604458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.604504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.604686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.605087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.617018] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1096.791885] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed098d0-aa55-4a88-be4f-3fe063ee74f6: rpc.has_security_group_logging(os_id): False [ 1096.811568] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.811815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.811815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.812464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.815645] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 in Status: SUCCESS [ 1096.815842] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24ebd7ab-0776-4822-9b99-4e4b98571494 deletion is rescheduled due to dependency. [ 1096.815962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24ebd7ab-0776-4822-9b99-4e4b98571494" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.850181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.850449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.850575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.850630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.850832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.850904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.851106] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.851212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.851282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.851534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.851618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.851843] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.851939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.851994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.852420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.852505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.852698] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1096.937607] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.938306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.938306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.938306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.938474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.952501] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1097.320037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd in Status: SUCCESS [ 1097.320037] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e44ebf-431f-48ef-9d59-768d3bda2cbd deletion is rescheduled due to dependency. [ 1097.320037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e44ebf-431f-48ef-9d59-768d3bda2cbd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.646310] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1097.646697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.646861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.646979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.647071] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.866235] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 in Status: SUCCESS [ 1097.866474] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34ac1819-3d29-4b4e-ac83-e39408cd6e49 deletion is rescheduled due to dependency. [ 1097.866607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34ac1819-3d29-4b4e-ac83-e39408cd6e49" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.149161] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.149389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.223276] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1098.223548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.223686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.223969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.224203] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.224354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.224425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.224597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.224673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.224777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.224886] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.628221] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1098.628547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.628739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.629050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.629314] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.629509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.629611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.629786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.629921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.630048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.630150] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.727804] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.728018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.728100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.728482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.728662] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.728800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.728905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.729086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.729209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.729333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.729541] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.729666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.729732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.729939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.730119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.730209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.730299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.730497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.730606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.730730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.730822] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.967671] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1098.967912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.132748] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.132928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.133010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.133295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.133482] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.133587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.133652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.133925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.133975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.134086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.134274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.134791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.134791] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.134923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.135041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.135147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.135201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.135359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.135473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.135620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.135781] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.233504] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71bd905-a59a-420e-96dc-4f48e2b11e86: rpc.has_security_group_logging(os_id): False [ 1099.252514] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.252514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.252514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.252514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.252514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.252843] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.252843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.252843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.252991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.252991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.253288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.253288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.253375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.253458] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.253571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.254118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.254118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.254118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.254118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.254359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.254359] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1099.320185] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.320416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.320505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.320721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.320864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.333592] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1099.638410] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1: rpc.has_security_group_logging(os_id): False [ 1099.657593] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.657743] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.657808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.658044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.658221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.658460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.658640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.658704] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.658865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.658945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.659145] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.659242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.659303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.659443] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.659516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.659719] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.659918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.660136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.660305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.660384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.660472] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1099.734917] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.734917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.734917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.734917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.734917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.745944] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1100.201710] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1100.204077] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1101.351251] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1101.351759] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.778343] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1101.778639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.778882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.779212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.779339] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.287613] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.287779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.287864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.288084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.288258] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.288726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.288823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.288997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.289097] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.289190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.289279] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.792879] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.792879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.793238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.793238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.793387] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.793464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.793505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.793649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.793774] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.793818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.794022] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.794136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.794195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.794346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.794500] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.794591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.794657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.794789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.794858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.795016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.795079] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.297068] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1: rpc.has_security_group_logging(os_id): False [ 1103.319873] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.319873] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.319873] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.319873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.320666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.320666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.320877] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.320972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.321022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.321207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.321295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.321383] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1103.394531] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.394531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.394531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.394765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.394800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.432822] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1105.203300] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.203300] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1105.329921] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed9c3287-0997-4ef7-aab8-c0720d85f3f9 req-1a38951d-c02a-4d14-9ecc-96ab0003f39f tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1105.330275] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1105.331023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.331023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.331023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.331023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.331249] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.331365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.331429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.331596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.331681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.331777] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.452716] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1105.452951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.653138] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.653138] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.653138] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.653138] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.660247] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.660247] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.660247] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.660247] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.660247] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.660247] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.660247] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.660247] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.660247] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.660247] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.660247] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.660247] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.680532] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.680709] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1105.680843] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.681032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.681453] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-66fb87f5-9b36-479a-a47f-c1dc7135375b taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.681636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.681753] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.682280] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.682422] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66fb87f5-9b36-479a-a47f-c1dc7135375b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.761455] env[65630]: INFO networking_nsxv3.common.synchronization [req-2b5ad2df-e77e-43f7-8f86-813b80d14287 req-ce404d3c-fa84-43b4-a28a-f71bc0ae7f65 tempest-ServerRescueNegativeTestJSON-830893404 tempest-ServerRescueNegativeTestJSON-830893404-project-member] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 1105.762060] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGHEST for action security_group_members [ 1105.762381] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.762515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.762577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.762777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.762928] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.763059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.763176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.763404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.763446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.763538] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.835911] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.185695] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.186044] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.186196] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.186622] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.186851] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.187139] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 66fb87f5-9b36-479a-a47f-c1dc7135375b not found, creating... [ 1106.187467] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.187678] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.187813] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.188078] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.188245] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.188594] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.188762] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.188920] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.189223] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.189373] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.189545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 66fb87f5-9b36-479a-a47f-c1dc7135375b is going to be created. [ 1106.210734] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.211088] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.211128] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.211370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.211593] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.211821] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.265814] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.265983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.266070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.266550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.266699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.266997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.267179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.267253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.267518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.267646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.267784] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be updated. [ 1106.296613] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.297162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.297162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.297162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.297313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.314123] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: IN_PROGRESS for 2s [ 1106.339634] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.842842] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.842842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.842978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.843211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.843371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.843475] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1106.877393] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.878416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.878416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.878416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.878416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.889700] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1106.907790] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed9c3287-0997-4ef7-aab8-c0720d85f3f9 req-78f2072e-ce22-4fee-81f0-b7ba4456cd17 service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1106.907965] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed9c3287-0997-4ef7-aab8-c0720d85f3f9 req-78f2072e-ce22-4fee-81f0-b7ba4456cd17 service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1106.908114] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed9c3287-0997-4ef7-aab8-c0720d85f3f9 req-78f2072e-ce22-4fee-81f0-b7ba4456cd17 service nova] Enqueued Resource ID: 66fb87f5-9b36-479a-a47f-c1dc7135375b with Priority: HIGHEST for action port [ 1106.908638] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1106.908770] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1106.908866] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66fb87f5-9b36-479a-a47f-c1dc7135375b with Priority: HIGHEST for action port [ 1106.909288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.909480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.909753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.909844] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.911607] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.911607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.911789] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-66fb87f5-9b36-479a-a47f-c1dc7135375b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.911915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.911994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.912273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.912340] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66fb87f5-9b36-479a-a47f-c1dc7135375b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.334181] env[65630]: INFO networking_nsxv3.common.synchronization [req-88ef1ace-fbec-4272-a407-7de4129ac566 req-ccb7fc49-2bde-4266-b6dd-fb49c1c93571 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1107.334794] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1107.335151] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.335315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.335392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.335758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.335980] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.336102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.336169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.336363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.336435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.336535] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.412486] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.412737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.414211] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66fb87f5-9b36-479a-a47f-c1dc7135375b with status ACTIVE [ 1107.414529] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.414687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.414762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.415041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.415234] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.415491] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.415610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.415676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.415883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.415971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.416203] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.416324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.416390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.416541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.416617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.416712] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66fb87f5-9b36-479a-a47f-c1dc7135375b is going to be updated. [ 1107.444784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.444946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.445099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.445324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.445472] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.445672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66fb87f5-9b36-479a-a47f-c1dc7135375b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.839118] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.839118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.839118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.839359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.839359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.839514] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.839649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.839649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.839798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.839863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.839924] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1107.878119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.878242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.878317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.878535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.878763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.890183] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1108.309143] env[65630]: INFO networking_nsxv3.common.synchronization [req-0be104f0-0289-49a2-83ad-590ef166c405 req-efbd6c73-b590-4199-95b9-667682ebaa29 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1108.309768] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1108.310123] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.310616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.310616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.310616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.310744] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.310744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.310819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.310927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.311020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.311136] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.339776] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e543f5-3a08-4982-8918-ea2593f725ef in Status: SUCCESS [ 1108.340223] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef deletion is rescheduled due to dependency. [ 1108.340223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.706564] env[65630]: INFO networking_nsxv3.common.synchronization [None req-2f5c133b-612e-45db-b6af-5324ce81d693 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1108.707172] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1108.707512] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.707617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.813030] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.902845] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1108.903223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.903544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.903868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.904255] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.904434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.904616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.904832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.905014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.905170] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.315315] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.408568] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.817900] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.818078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.818151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.818372] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.818484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.818589] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1109.845612] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.845802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.845878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.846078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.846268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.856615] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1109.900252] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1109.900439] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1109.900563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.912268] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.276520] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-e94e9c71-9bd9-4e23-b2a6-f4724634dc74 tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1110.278707] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1110.279524] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.279524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.279524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.279890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.279946] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.280079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.280127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.280283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.280360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.280457] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.415019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.415019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.415019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.415415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.415415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.415415] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1110.449238] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.449470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.449582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.449889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.450115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.460943] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1110.668701] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.668928] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.669042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.669410] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.670290] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.670507] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.670629] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.670889] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.671049] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.671293] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.671421] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.671522] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.671663] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.671728] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.671838] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.672084] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.698479] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.698623] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.698889] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.699219] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.699819] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-023fd767-73b5-4fe0-b82d-f47f7f419b4e taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.700052] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.700265] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.700833] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.701139] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023fd767-73b5-4fe0-b82d-f47f7f419b4e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.783015] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.783287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.783373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.783778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.783928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.784312] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.784470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.784503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.784675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.784757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.784849] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 already deleted. [ 1110.784951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.204553] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.204841] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.205015] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.205389] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.205577] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.205778] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 023fd767-73b5-4fe0-b82d-f47f7f419b4e not found, creating... [ 1111.206121] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.206300] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.206423] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.207027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.207027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.207197] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.207292] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.207382] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.207592] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.207727] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.207867] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 023fd767-73b5-4fe0-b82d-f47f7f419b4e is going to be created. [ 1111.231603] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.231820] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.231946] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.232303] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.233027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.233027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.870528] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1111.871120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.871120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.871402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.871611] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.871819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.871940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.872259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.872353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.872486] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.970141] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-bc419f96-633d-42c9-9653-eaa19d3e9114 service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1111.970365] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-bc419f96-633d-42c9-9653-eaa19d3e9114 service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1111.970638] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-bc419f96-633d-42c9-9653-eaa19d3e9114 service nova] Enqueued Resource ID: 023fd767-73b5-4fe0-b82d-f47f7f419b4e with Priority: HIGHEST for action port [ 1111.971311] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1111.971474] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1111.971590] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023fd767-73b5-4fe0-b82d-f47f7f419b4e with Priority: HIGHEST for action port [ 1111.971893] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.972055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.973737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.973737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.973737] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.973737] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.973958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.973958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.974059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.974969] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.974969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.974969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.974969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.974969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.974969] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.975732] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-023fd767-73b5-4fe0-b82d-f47f7f419b4e taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.975866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.975963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.976571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.977906] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023fd767-73b5-4fe0-b82d-f47f7f419b4e',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.029524] env[65630]: INFO networking_nsxv3.common.synchronization [req-429cc975-c559-4c0a-b48b-6c54c137f1e0 req-36d814da-f906-42df-b0ff-cccf2209147f tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_members [ 1112.030123] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260959d6-44de-432d-a8ee-ce634ff440ed with Priority: HIGHEST for action security_group_members [ 1112.030434] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-260959d6-44de-432d-a8ee-ce634ff440ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.030559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.030650] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.030893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.031013] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.031164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.031230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.031409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.031502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.031592] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260959d6-44de-432d-a8ee-ce634ff440ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.377447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.377656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.377731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.377953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.378063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.378271] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.378374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.378434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.378670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.378768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.378870] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1112.409389] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.409389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.409389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.409748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.409875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.424361] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1112.474231] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1112.474717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.474918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.475267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.475570] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.475795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.475900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.476203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.476350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.476465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.476605] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.477915] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.478103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.478327] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.479545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 023fd767-73b5-4fe0-b82d-f47f7f419b4e with status ACTIVE [ 1112.479831] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.479984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.480088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.480329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.480511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.480728] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.480873] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.480975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.481242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.481324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.481600] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.481713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.481808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.482041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.482182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.482301] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 023fd767-73b5-4fe0-b82d-f47f7f419b4e is going to be updated. [ 1112.509515] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.509701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.509756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.510015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.510196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.510371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-023fd767-73b5-4fe0-b82d-f47f7f419b4e" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.534287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.534287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.534287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.534508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.558491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.558491] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.558681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.558681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.559814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.559814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.559814] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260959d6-44de-432d-a8ee-ce634ff440ed is going to be updated. [ 1112.603099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.603099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.603099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.603099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.603099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.620499] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260959d6-44de-432d-a8ee-ce634ff440ed in Status: IN_PROGRESS for 2s [ 1112.816754] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-42444bc3-4485-4b05-a078-8a1a6d6cb5cd tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1112.817356] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1112.817682] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.817787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.980100] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.980419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.980419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.981025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.981025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.981201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.981201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.981697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.981697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.981697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.981697] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.981865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.981865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.982045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.982158] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.982263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.982337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.982552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.982593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.982661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.982841] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.984104] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.183899] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.184123] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.184309] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.184614] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.185479] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.185479] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.185479] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.185479] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.185816] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.185816] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.185914] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.185960] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.186101] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.186170] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.186307] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.186405] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.206494] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.206653] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1113.207788] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.207788] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.207788] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-a2a1b55d-c41e-40ed-8771-bd4306c63f90 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.207788] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.207788] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.208043] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.208264] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2a1b55d-c41e-40ed-8771-bd4306c63f90',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.486016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d84857eb-b557-4aa2-8d62-34137b9cab1f: rpc.has_security_group_logging(os_id): False [ 1113.487399] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.487625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.487625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.487800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.487890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.487983] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be created. [ 1113.508150] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.508326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.508326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.508529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.517534] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.517689] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.517742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.517960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.518135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.530100] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: UNINITIALIZED for 2s [ 1113.531734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.532036] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.532216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.532255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.532449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.532549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.532767] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.532882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.532968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.533167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.533246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.533460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.533568] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.533624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.533763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.533837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.533937] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1113.607905] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.608271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.608516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.608971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.609335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.629961] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1113.710953] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.711246] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.711410] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.711748] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.711911] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.712158] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port a2a1b55d-c41e-40ed-8771-bd4306c63f90 not found, creating... [ 1113.712420] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.712608] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.712740] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.712991] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.713143] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.713456] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.713677] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.713808] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.714064] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.714227] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.714393] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: a2a1b55d-c41e-40ed-8771-bd4306c63f90 is going to be created. [ 1113.736592] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.737012] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.737179] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.737451] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.737676] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.737909] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.435815] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1114.436091] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 deletion is rescheduled due to dependency. [ 1114.436136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.631666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260959d6-44de-432d-a8ee-ce634ff440ed in Status: SUCCESS [ 1114.631891] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260959d6-44de-432d-a8ee-ce634ff440ed deletion is rescheduled due to dependency. [ 1114.632052] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260959d6-44de-432d-a8ee-ce634ff440ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.004361] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-bfe7bbd4-da49-419b-8781-d0367056168c service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1115.004555] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-bfe7bbd4-da49-419b-8781-d0367056168c service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1115.004924] env[65630]: INFO networking_nsxv3.common.synchronization [req-0b1a194f-cfac-42b1-8af6-2b428fae436a req-bfe7bbd4-da49-419b-8781-d0367056168c service nova] Enqueued Resource ID: a2a1b55d-c41e-40ed-8771-bd4306c63f90 with Priority: HIGHEST for action port [ 1115.005362] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1115.005565] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1115.006130] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2a1b55d-c41e-40ed-8771-bd4306c63f90 with Priority: HIGHEST for action port [ 1115.006130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.006130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.006530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.006530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.006530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2a1b55d-c41e-40ed-8771-bd4306c63f90 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.006691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.006691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.006848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.007087] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2a1b55d-c41e-40ed-8771-bd4306c63f90',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.345840] env[65630]: INFO networking_nsxv3.common.synchronization [req-8f58bcbb-32fa-4636-af02-c5f2182867a5 req-4fea7974-54ab-4f93-bde5-7488603a416b tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_members [ 1115.346828] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_members [ 1115.346828] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.346928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.346971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.347284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.347484] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.347569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.347614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.347765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.347847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.347939] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.509233] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2a1b55d-c41e-40ed-8771-bd4306c63f90 with status ACTIVE [ 1115.509503] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.509610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.509675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.509900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.509982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.510176] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.510715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.510715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.510715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.510715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.510913] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.510913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.510913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.511040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.512051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.512051] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2a1b55d-c41e-40ed-8771-bd4306c63f90 is going to be updated. [ 1115.531606] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.531765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.531843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.532051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.532221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.532384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2a1b55d-c41e-40ed-8771-bd4306c63f90" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.540985] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1115.541294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.541479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.541683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.541868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.541986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.542059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.542246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.542367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.542507] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.542660] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.543908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.543908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.544206] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.544254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.544331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.544445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.544523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.544615] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.655805] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1115.655805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.697642] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.697780] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.697906] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.698213] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.698506] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.698722] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.698793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.699023] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.699176] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.699395] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.699508] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.699614] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.699719] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.699828] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.699931] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.700075] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.732106] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.732457] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.732682] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.732899] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.733264] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.733537] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.733685] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.734033] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.734291] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc296c6-e7b4-46fb-8a03-ed8473bc933a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.850241] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.850410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.850483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.850760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.850859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.851091] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.851199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.851263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.851426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.851510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.851613] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 already deleted. [ 1115.851672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.047510] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.047510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.047510] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.242103] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.242103] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port ccc296c6-e7b4-46fb-8a03-ed8473bc933a not found, creating... [ 1116.242103] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.242103] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.242553] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.242553] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.242553] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.243032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.243390] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.243679] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: ccc296c6-e7b4-46fb-8a03-ed8473bc933a is going to be created. [ 1116.266022] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.266022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.266022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.266022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.266022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.266022] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.548814] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.011647] env[65630]: INFO networking_nsxv3.common.synchronization [req-8f58bcbb-32fa-4636-af02-c5f2182867a5 req-a5d46eed-5cbd-4204-8767-2e55a8269167 service nova] Enqueued Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_rules [ 1117.012259] env[65630]: INFO networking_nsxv3.common.synchronization [req-8f58bcbb-32fa-4636-af02-c5f2182867a5 req-a5d46eed-5cbd-4204-8767-2e55a8269167 service nova] Enqueued Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_members [ 1117.012585] env[65630]: INFO networking_nsxv3.common.synchronization [req-8f58bcbb-32fa-4636-af02-c5f2182867a5 req-a5d46eed-5cbd-4204-8767-2e55a8269167 service nova] Enqueued Resource ID: ccc296c6-e7b4-46fb-8a03-ed8473bc933a with Priority: HIGHEST for action port [ 1117.013027] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_rules [ 1117.013119] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_members [ 1117.013225] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc296c6-e7b4-46fb-8a03-ed8473bc933a with Priority: HIGHEST for action port [ 1117.013605] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.013728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.013790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.013990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.014083] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.015102] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.015231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.015307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.015473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.015631] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.015731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.015792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.015935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.019720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.019720] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.019720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.019720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.019720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.019720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.019720] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc296c6-e7b4-46fb-8a03-ed8473bc933a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.053249] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.053402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.053454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.053675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.053764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.053853] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1117.083039] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.083160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.083233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.083461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.083640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.096387] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1117.521374] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.521581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.521684] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.523481] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccc296c6-e7b4-46fb-8a03-ed8473bc933a with status ACTIVE [ 1117.523915] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.524212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.524324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.525376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.525494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.525852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.525986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.526058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.526259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.526344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.526558] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.526664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.526717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.526864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.526943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.527079] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccc296c6-e7b4-46fb-8a03-ed8473bc933a is going to be updated. [ 1117.556714] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.557100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.557100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.557323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.557505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.557713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccc296c6-e7b4-46fb-8a03-ed8473bc933a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.029465] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.536016] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.536016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.536016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.536016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.536016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.536016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 is going to be created. [ 1118.562515] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.562860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.562860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.562963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.563135] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.573833] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 in Status: UNINITIALIZED for 2s [ 1119.109187] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1119.109413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.109668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.110042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.110153] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.110250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.110316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.110539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.110649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.110726] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.612898] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.780081] env[65630]: INFO networking_nsxv3.common.synchronization [req-e7a1b341-0357-4b23-a2ec-d8b9ce1916ec req-43e7f0aa-dc23-4567-b2de-0f67c12f83f4 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1119.780695] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1119.781261] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.781261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.781261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.781668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.781668] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.781668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.781668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.781911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.781911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.782014] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.116448] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.286060] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.532206] env[65630]: INFO networking_nsxv3.common.synchronization [req-a45c4e35-b553-41fb-8f86-458986ed8032 req-f8274dd5-167b-401a-a11c-867da1e9aea0 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1120.532924] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1120.535311] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.535464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.535536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.535743] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.535907] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.536016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.536084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.536239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.537134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.537291] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.587553] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 in Status: SUCCESS [ 1120.587807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.588026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.588459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.588630] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.588831] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.588930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.589122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.589213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.589303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.589397] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.619791] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.620118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.620118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.620214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.620302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.620421] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1120.666412] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.666589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.666641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.666832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.667070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.676465] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1120.788535] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.041810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.041810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.041810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.041810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.041810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.042638] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.042638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.042638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.043108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.043273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.046505] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1121.080495] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.080642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.080711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.080916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.081074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.091459] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1121.092304] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.295288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.295494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.295584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.295880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.295993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.296162] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1121.347955] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.348106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.348175] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.348394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.348534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.362421] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1121.593830] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8ae8320-e1e0-4786-a4ef-76ef36da2f81: rpc.has_security_group_logging(os_id): False [ 1121.617661] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.617862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.619335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.620073] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.620411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.622819] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.622913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.622913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.623157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.623248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.623449] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 is going to be created. [ 1121.697164] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.697344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.697401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.697601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.697778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.712668] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 in Status: IN_PROGRESS for 2s [ 1122.388261] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b68d2461-0874-46b7-bdca-b5a4c5b9eac6 tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1122.388487] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1122.388957] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.389224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.389446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.389785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.390020] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.488030] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e60b67c3-f77a-4f8c-9bfd-20bccee42b6d tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1122.488030] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1122.488030] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.488030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.687654] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1122.687654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.687929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.688033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.688224] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.688354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.688434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.689160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.689160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.689160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.689160] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.689160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.689160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.689160] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.689426] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.689426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.689426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.689553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.689974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.689974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.689974] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.914956] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.915191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.915881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.915881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.915881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.915881] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b already deleted. [ 1122.916071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.916166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.916353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.916456] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.103622] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1123.103622] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 deletion is rescheduled due to dependency. [ 1123.103622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.192410] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adaa915d-681a-4aa6-acf8-0488514134f3: rpc.has_security_group_logging(os_id): False [ 1123.212119] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.212296] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.212367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.212581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.212672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.212892] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.212994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.213072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.213220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.213295] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.213479] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.213621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.213723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.213900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.213979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.214181] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.214302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.214384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.214505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.214579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.214666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be created. [ 1123.280327] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.280493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.280560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.280801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.280979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.294375] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1123.386866] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1123.387159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.441229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.441382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.441503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.441708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.442401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.442401] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b already deleted. [ 1123.442401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.725774] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 in Status: SUCCESS [ 1123.726046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.307576] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1125.308055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.308055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.308224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.308310] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.810513] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.810675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.810750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.810992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.811349] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.811349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.812176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.812176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.812176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.812176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.812176] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.317830] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.318188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.318188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.318280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.318415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.318534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.318605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.319294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.319294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.319294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.319294] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.319294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.319294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.319537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.319572] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.319645] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.319723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.319935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.320044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.320136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.320215] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.823040] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adaa915d-681a-4aa6-acf8-0488514134f3: rpc.has_security_group_logging(os_id): False [ 1126.842597] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.842805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.842895] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.843221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.843293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.843559] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.843683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.843756] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.845183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.845183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.845183] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.845183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.845183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.845183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.845183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.845183] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.845183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.845671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.845671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.845671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.845790] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1126.939111] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.939327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.939471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.939813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.940042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.958197] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1127.487417] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.487723] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1128.546128] env[65630]: INFO networking_nsxv3.common.synchronization [req-fe294363-0e48-4fb1-a5e2-4c6c26632985 req-4cab13d0-56ab-4de3-b472-1ec631eda826 tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1128.546128] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1128.546128] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.546128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.546128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.550977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.551321] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.553475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.553475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.553475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.553475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.553475] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.746864] env[65630]: INFO networking_nsxv3.common.synchronization [req-79a3ea16-fe38-40e3-bf92-72628a89c621 req-afd81c26-bf99-42f1-aad1-27a8920f977b tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1128.746864] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1128.746864] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.746864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.976084] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1128.976926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.054586] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.558723] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.060962] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.061142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.061214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.061463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.061554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.061664] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1130.093034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.093257] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.093371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.093668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.093886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.103962] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1132.116209] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1132.117326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.117326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.117326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.117326] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.117326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.117326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.117560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.117560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.117560] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.621568] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.622070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.622070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.622070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.622244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.623045] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.623045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.623045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.623045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.623045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.623045] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1132.650113] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.650286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.650330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.650518] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.650653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.659739] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1133.746890] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1133.747155] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1134.672158] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1134.672158] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 deletion is rescheduled due to dependency. [ 1134.672158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.757800] env[65630]: INFO networking_nsxv3.common.synchronization [None req-b14d6023-1dc8-4a35-b6f4-bb0705c4d552 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1134.758278] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1134.758628] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.758800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.758847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.759129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.759214] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.840288] env[65630]: INFO networking_nsxv3.common.synchronization [None req-58ef24a7-4ff1-4825-b5af-69c73de77d62 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1134.840288] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1134.840288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.840288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.279705] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.279880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.279955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.280199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.280294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.280396] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 already deleted. [ 1135.280480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.280640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.280796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.280906] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.803517] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.803969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.803969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.804083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.804183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.804279] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 already deleted. [ 1135.804376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.198055] env[65630]: INFO networking_nsxv3.common.synchronization [req-2e69b875-5bda-4d06-874c-c2865e527e88 req-e0940435-0e08-4904-84a4-e95d09775f91 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1138.198634] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1138.199330] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.199330] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.199517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.199700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.199767] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.199866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.199942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.200101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.200801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.200801] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.513898] env[65630]: INFO networking_nsxv3.common.synchronization [req-beea27b2-df74-4808-8f68-e5d772ffdfb7 req-10089a78-66a7-40dd-b3bb-1b2a6eb3dcba tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1138.514096] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1138.514455] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.514624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.514725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.514960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.515197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.515336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.515424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.515615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.515721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.515838] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.534910] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.535178] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.535370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.535657] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.536336] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.536546] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.536586] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.536793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.537013] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.537295] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.537444] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.537571] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.537682] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.537865] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.538032] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.538302] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.560619] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.560803] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.560942] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.561167] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.561455] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-3e681587-71e3-48db-89cd-c9e2a3991d9f taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.561636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.561765] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.562216] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.562362] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e681587-71e3-48db-89cd-c9e2a3991d9f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.703333] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.703521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.703621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.703834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.703926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.704194] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.704305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.704375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.704618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.704678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.704767] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1138.740683] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.740839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.741598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.741598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.741598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.752268] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1139.019287] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.065234] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.065654] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.065799] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.066106] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.066268] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.066428] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 3e681587-71e3-48db-89cd-c9e2a3991d9f not found, creating... [ 1139.066700] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.066863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.066980] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.067300] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.067473] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.068208] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.068456] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.068608] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.068855] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.069041] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.069220] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 3e681587-71e3-48db-89cd-c9e2a3991d9f is going to be created. [ 1139.090707] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.090884] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.091042] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.091302] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.091537] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.091809] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.521214] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.791516] env[65630]: INFO networking_nsxv3.common.synchronization [req-2e69b875-5bda-4d06-874c-c2865e527e88 req-c0bb774d-a081-4668-b7e0-21beb3c71db7 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1139.791568] env[65630]: INFO networking_nsxv3.common.synchronization [req-2e69b875-5bda-4d06-874c-c2865e527e88 req-c0bb774d-a081-4668-b7e0-21beb3c71db7 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1139.791682] env[65630]: INFO networking_nsxv3.common.synchronization [req-2e69b875-5bda-4d06-874c-c2865e527e88 req-c0bb774d-a081-4668-b7e0-21beb3c71db7 service nova] Enqueued Resource ID: 3e681587-71e3-48db-89cd-c9e2a3991d9f with Priority: HIGHEST for action port [ 1139.792225] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1139.792358] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1139.792590] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e681587-71e3-48db-89cd-c9e2a3991d9f with Priority: HIGHEST for action port [ 1139.792742] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.792865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.792930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.793149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.793226] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.794123] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.794212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.794366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e681587-71e3-48db-89cd-c9e2a3991d9f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.794473] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.794845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.794845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.794845] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e681587-71e3-48db-89cd-c9e2a3991d9f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.024147] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.024316] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.024386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.024710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.024816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.024960] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1140.074267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.074358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.074415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.074701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.074853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.087061] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1140.297270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.297421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.297583] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e681587-71e3-48db-89cd-c9e2a3991d9f with status ACTIVE [ 1140.297756] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.297868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.297955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.298173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.298260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.298432] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.298530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.298587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.298745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.298823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.299014] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.299101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.299203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.299325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.299393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.299477] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e681587-71e3-48db-89cd-c9e2a3991d9f is going to be updated. [ 1140.322066] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.322246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.322321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.322601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.322752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.322945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e681587-71e3-48db-89cd-c9e2a3991d9f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.761633] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1140.761897] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 deletion is rescheduled due to dependency. [ 1140.761935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.762117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.762373] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.762539] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.762648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.762718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.762872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.762955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.763071] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.265503] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.768241] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.097764] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1142.098033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.271812] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.271812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.271812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.271812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.271812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.271812] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1142.301269] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.301385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.301385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.301587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.301732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.311533] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1142.402518] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1f910e2f-dba9-4d05-8f73-c4db9bfce157 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_rules [ 1142.403139] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_rules [ 1142.403461] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.403621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.403661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.403906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.404043] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.499129] env[65630]: INFO networking_nsxv3.common.synchronization [None req-1dc743b5-d1b9-465f-9a40-00131485bff8 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_rules [ 1142.499707] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_rules [ 1142.500187] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.500266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.929784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.930232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.930232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.930232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.930449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.930449] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb already deleted. [ 1142.930541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.930619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.930770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.930853] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.456773] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.456977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.456977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.457223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.457371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.457454] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb already deleted. [ 1143.457531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.322164] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1144.322164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.322164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.322611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.322611] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.322611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.322611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.322785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.322830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.322917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.323018] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.825551] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.825829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.825880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.826151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.826343] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.826612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.826612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.826724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.826798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.826962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.827234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.827405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.827405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.827614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.827720] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.827822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.827887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.828058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.828146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.828245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.828361] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.331047] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed098d0-aa55-4a88-be4f-3fe063ee74f6: rpc.has_security_group_logging(os_id): False [ 1145.351864] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.352042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.352105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.352310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.352392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.352655] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.352771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.352836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.352997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.353085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.353271] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.353357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.353410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.353554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.353619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.353820] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.353926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.353982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.354123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.354191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.354277] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1145.421475] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.421719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.421719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.423026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.423026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.435298] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1145.608059] env[65630]: INFO networking_nsxv3.common.synchronization [req-868ad53b-43d0-4148-8eac-b9337bda8188 req-4dad97df-f04e-4f37-89c9-733d04e24fd7 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1145.608717] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1145.609142] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.609494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.609494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.609635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.609797] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.609924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.609988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.610162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.610245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.610337] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.112366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.112666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.112824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.113074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.137012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.137012] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.137012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.137012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.137012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.137012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.137012] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1146.163046] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.163286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.163467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.163775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.164016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.174203] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1147.285728] env[65630]: INFO networking_nsxv3.common.synchronization [req-c71226d5-8ef6-407f-b5eb-d4eb9f200d69 req-fe65c60a-5500-4702-a2ff-214488545cce tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1147.285728] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1147.285728] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.287233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.287447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.289989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.289989] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.289989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.289989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.289989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.289989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.289989] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.451279] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1147.451522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.590472] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.590750] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.590879] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.591165] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.591452] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.591669] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.591821] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.592472] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.592562] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.592782] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.593041] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.593405] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.593648] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.593833] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.593956] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.594117] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.613228] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.613390] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1147.613587] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.613794] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.614136] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-0a6c2437-dd8c-488e-ac04-f26243492e29 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.614317] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.614429] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.614818] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.614954] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6c2437-dd8c-488e-ac04-f26243492e29',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.792167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.792343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.792414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.792631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.792749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.792964] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.793058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.793095] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.793244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.793370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.793370] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b already deleted. [ 1147.793449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.117686] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.117927] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.118067] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.118357] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.119035] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.119035] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 0a6c2437-dd8c-488e-ac04-f26243492e29 not found, creating... [ 1148.119035] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.119300] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.119300] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.119392] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.119522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.119797] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.120089] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.120089] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.120396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.120553] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.120695] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 is going to be created. [ 1148.141554] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.141774] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.141953] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.142250] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.143028] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.143143] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.184134] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1148.184752] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 1148.185013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.883576] env[65630]: INFO networking_nsxv3.common.synchronization [req-c71226d5-8ef6-407f-b5eb-d4eb9f200d69 req-b38c23b5-d97b-4b38-bc02-8a5613c3cca7 service nova] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1148.883876] env[65630]: INFO networking_nsxv3.common.synchronization [req-c71226d5-8ef6-407f-b5eb-d4eb9f200d69 req-b38c23b5-d97b-4b38-bc02-8a5613c3cca7 service nova] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1148.883969] env[65630]: INFO networking_nsxv3.common.synchronization [req-c71226d5-8ef6-407f-b5eb-d4eb9f200d69 req-b38c23b5-d97b-4b38-bc02-8a5613c3cca7 service nova] Enqueued Resource ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 with Priority: HIGHEST for action port [ 1148.884779] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1148.884981] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1148.885077] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 with Priority: HIGHEST for action port [ 1148.885401] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.885545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.885613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.885898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.885992] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.887922] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.887922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.887922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.887922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.887922] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.887922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.887922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.887922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.888536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.888609] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.891045] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a6c2437-dd8c-488e-ac04-f26243492e29 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.891045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.891045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.891045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.891045] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6c2437-dd8c-488e-ac04-f26243492e29',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.392229] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.394235] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.394370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.394528] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a6c2437-dd8c-488e-ac04-f26243492e29 with status ACTIVE [ 1149.394741] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.394884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.394965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.395245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.395306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.395481] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.395597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.395696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.396247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.396247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.396247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.396247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.396426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.396426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.396526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.396624] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 is going to be updated. [ 1149.424060] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.424334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.424482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.424786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.425060] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.425336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.893922] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.397260] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.397444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.397444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.397655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.397761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.397925] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b is going to be created. [ 1150.430253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.430478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.430478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.431460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.431460] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.445507] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: UNINITIALIZED for 2s [ 1152.457808] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: SUCCESS [ 1152.458280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.458280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.458422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.458615] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.458735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.458810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.458945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.459042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.459164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.459230] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.961933] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.465600] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0f42bcf-1192-403d-b71c-67a606089c6b: rpc.has_security_group_logging(os_id): False [ 1153.485558] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.485745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.485829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.486088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.486206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.486462] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.486565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.486631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.486790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.486867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.486954] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b is going to be created. [ 1153.631693] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.631908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.631908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.632131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.632319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.643953] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: IN_PROGRESS for 2s [ 1153.886336] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1153.887040] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1155.663408] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: SUCCESS [ 1155.663747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.887518] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1158.888715] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1159.084351] env[65630]: INFO networking_nsxv3.common.synchronization [req-29829ba0-1d25-4d32-9a2c-a4a4509c2530 req-f954a615-2a19-43ab-a8f8-6889a6b7a593 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1159.084445] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1159.084987] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.084987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.084987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.085239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.085381] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.085481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.085592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.085700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.085770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.085882] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.379057] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.379057] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.379057] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.379304] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.379530] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.379695] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.379812] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.380045] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.380203] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.380424] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.380537] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.380641] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.380747] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.380851] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.380954] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.381101] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.402740] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.402986] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.403205] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.403433] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.403834] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-318d52eb-83c1-4267-9af6-4d63dccb05cd taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.404102] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.404292] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.404675] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.404943] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('318d52eb-83c1-4267-9af6-4d63dccb05cd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.589367] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.589566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.589619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.589805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.589900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.590133] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.590231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.590293] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.590446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.590525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.590613] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1159.617796] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.617796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.618023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.618985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.618985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.630536] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1159.907883] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.908677] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.908677] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.908908] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.909157] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.909414] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 318d52eb-83c1-4267-9af6-4d63dccb05cd not found, creating... [ 1159.909869] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.910344] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.910344] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.910602] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.910816] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.911344] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.911551] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.911733] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.911995] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.912221] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.912390] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 318d52eb-83c1-4267-9af6-4d63dccb05cd is going to be created. [ 1159.937499] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.937740] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.937880] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.938298] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.938493] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.938751] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.661134] env[65630]: INFO networking_nsxv3.common.synchronization [req-29829ba0-1d25-4d32-9a2c-a4a4509c2530 req-0abfcb56-b331-45a3-90b2-8cad6c22524d service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1160.661327] env[65630]: INFO networking_nsxv3.common.synchronization [req-29829ba0-1d25-4d32-9a2c-a4a4509c2530 req-0abfcb56-b331-45a3-90b2-8cad6c22524d service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1160.661464] env[65630]: INFO networking_nsxv3.common.synchronization [req-29829ba0-1d25-4d32-9a2c-a4a4509c2530 req-0abfcb56-b331-45a3-90b2-8cad6c22524d service nova] Enqueued Resource ID: 318d52eb-83c1-4267-9af6-4d63dccb05cd with Priority: HIGHEST for action port [ 1160.661995] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1160.662155] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1160.662252] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 318d52eb-83c1-4267-9af6-4d63dccb05cd with Priority: HIGHEST for action port [ 1160.662525] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.662715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.662715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.662902] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.663312] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.664429] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.664625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.664901] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-318d52eb-83c1-4267-9af6-4d63dccb05cd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.665023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.665113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.665271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.665349] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('318d52eb-83c1-4267-9af6-4d63dccb05cd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.165025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.165349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.172554] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 318d52eb-83c1-4267-9af6-4d63dccb05cd with status ACTIVE [ 1161.172554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.172554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.172765] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.172897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.172995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.173206] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.173327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.173403] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.173574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.173652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.173838] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.173933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.173994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.174157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.174230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.174317] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 318d52eb-83c1-4267-9af6-4d63dccb05cd is going to be updated. [ 1161.206311] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.206474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.206535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.206729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.206944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.207045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-318d52eb-83c1-4267-9af6-4d63dccb05cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.437013] env[65630]: INFO networking_nsxv3.common.synchronization [req-7479d54b-d6ab-49e3-97c2-2797ddd9527b req-c48339b1-9506-4292-bdc6-13456dd87aad tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1161.437969] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1161.438810] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.438980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.439056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.439317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.439501] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.439640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.439686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.439848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.440037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.440219] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.640408] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1161.640629] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1161.640687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.640858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.641090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.641274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.641393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.641449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.641607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.641690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.641801] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.756651] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.756849] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.756924] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.757286] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.757549] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.757707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.757826] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.758059] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.758207] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.758411] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.758521] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.758626] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.758732] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.758837] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.758939] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.759083] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.784964] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.785218] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1161.785316] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.785487] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.785837] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.786201] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.786201] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.786522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.786661] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.942981] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.943146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.943146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.943313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.943404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.943601] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.943701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.943764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.943924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.943999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.944093] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 already deleted. [ 1161.944177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.145097] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.289562] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.289841] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.289917] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.290244] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.290986] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.291225] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d not found, creating... [ 1162.291527] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.291718] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.291843] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.292113] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.292273] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.292564] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.292895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.292895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.293097] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.293200] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.293341] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d is going to be created. [ 1162.315155] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.315512] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.315656] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.316246] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.316318] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.316506] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.647411] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.075785] env[65630]: INFO networking_nsxv3.common.synchronization [req-7479d54b-d6ab-49e3-97c2-2797ddd9527b req-7ba17948-97e5-4cfe-9eaf-9dbe54b5bbe4 service nova] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1163.075999] env[65630]: INFO networking_nsxv3.common.synchronization [req-7479d54b-d6ab-49e3-97c2-2797ddd9527b req-7ba17948-97e5-4cfe-9eaf-9dbe54b5bbe4 service nova] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1163.076184] env[65630]: INFO networking_nsxv3.common.synchronization [req-7479d54b-d6ab-49e3-97c2-2797ddd9527b req-7ba17948-97e5-4cfe-9eaf-9dbe54b5bbe4 service nova] Enqueued Resource ID: 0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d with Priority: HIGHEST for action port [ 1163.076689] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1163.076831] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1163.076928] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d with Priority: HIGHEST for action port [ 1163.077234] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.077876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.077876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.078142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.078142] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.079476] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.079613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.079681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.079865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.080041] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.080140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.080202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.080346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.080433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.080525] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.081703] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.081821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.081927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.082148] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.082242] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.149469] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.149635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.149709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.149924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.150039] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.150121] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1163.177399] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.177555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.177604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.177846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.178035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.187471] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1163.580521] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.580949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.584089] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d with status ACTIVE [ 1163.584276] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.584416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.584517] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.584700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.584792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.585047] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.585146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.585260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.585432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.585588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.585671] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.585767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.585841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.585987] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.586086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.586213] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d is going to be updated. [ 1163.587271] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.620202] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.620395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.620434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.620632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.620753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.620916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab97765-fa0b-4c7d-bf2f-9f5efa28b02d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.090513] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.593782] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.594107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.594107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.594249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.594337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.594433] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be created. [ 1164.618918] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.619128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.619128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.619343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.619499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.630547] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: UNINITIALIZED for 2s [ 1165.199847] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1165.200161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.200386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.200646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.200870] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.201058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.201142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.201310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.201430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.201536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.201577] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.703825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.704185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.704185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.704296] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.704458] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.704596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.704626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.704792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.704997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.705103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.705255] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.706470] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.706470] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.706470] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.208889] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71bd905-a59a-420e-96dc-4f48e2b11e86: rpc.has_security_group_logging(os_id): False [ 1166.228858] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.229028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.229103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.229323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.229414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.229610] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.229710] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.229773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.229929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.230015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.230227] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.230324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.230385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.230526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.230627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.230832] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.230951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.231026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.231186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.231263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.231349] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1166.293992] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.294297] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.294420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.294720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.295023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.309847] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1166.642719] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: SUCCESS [ 1166.642966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.643126] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.643374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.643590] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.643708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.643761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.643915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.644012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.644082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.644178] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.147029] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.651399] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d30328a0-3fe7-4b9c-8fb4-3748bb068910: rpc.has_security_group_logging(os_id): False [ 1167.674484] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.674628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.674703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.674949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.675061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.675351] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.675420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.675500] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.675664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.675741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.675830] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be created. [ 1167.740919] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.740919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.740919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.741220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.741342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.756681] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: IN_PROGRESS for 2s [ 1168.077900] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1168.077900] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1168.310750] env[65630]: INFO networking_nsxv3.common.synchronization [req-543e9912-8708-49cd-8145-c80f872b3b5c req-ff55a54e-1366-4740-b3a6-131f22e59083 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_members [ 1168.313305] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_members [ 1168.314095] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f6b8a5b-bd24-49ea-96d6-51163d266deb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.318225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.318225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.318225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.318225] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.318225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.318225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.318225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.318225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.318225] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.334123] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1168.334398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.337328] env[65630]: INFO networking_nsxv3.common.synchronization [req-2b131c74-1305-4110-9e50-7dcb586cd80b req-5f8a9a26-c6eb-443d-bd95-10e0c00ca375 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1168.340732] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1168.340732] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.340912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.340949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.341225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.341529] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.341690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.341742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.341998] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.342138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.342460] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.738499] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.738685] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.738804] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.739100] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.739743] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.739743] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.739743] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.740085] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.740085] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.742874] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.743267] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.743267] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.743456] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.743544] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.743658] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.743800] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.768865] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.768865] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.768865] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.768865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.768865] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-89358c9c-a651-4a30-bf54-cee1e44af9a9 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.768865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.768865] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.769966] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.769966] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89358c9c-a651-4a30-bf54-cee1e44af9a9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.818432] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.818512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.818546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.818749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.818841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.819047] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.819947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.819947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.819947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.819947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.819947] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb already deleted. [ 1168.819947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.844691] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.844857] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.844990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.845232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.865640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.866025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.866107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.866235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.866487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.866616] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.866846] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1168.902253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.902659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.902758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.904666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.904666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.915372] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1169.275083] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.275083] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.275083] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.275443] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.275443] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.275591] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 89358c9c-a651-4a30-bf54-cee1e44af9a9 not found, creating... [ 1169.275845] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.276050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.276153] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.276395] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.276525] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.276934] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.277215] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.277370] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.277630] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.277795] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.277938] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 89358c9c-a651-4a30-bf54-cee1e44af9a9 is going to be created. [ 1169.301059] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.301279] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.301279] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.302146] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.302580] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.302889] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.769666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: SUCCESS [ 1169.769980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.064139] env[65630]: INFO networking_nsxv3.common.synchronization [req-543e9912-8708-49cd-8145-c80f872b3b5c req-0b0f4105-8af7-4730-8d46-8c3da7c765c6 service nova] Enqueued Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_rules [ 1170.064368] env[65630]: INFO networking_nsxv3.common.synchronization [req-543e9912-8708-49cd-8145-c80f872b3b5c req-0b0f4105-8af7-4730-8d46-8c3da7c765c6 service nova] Enqueued Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_members [ 1170.064509] env[65630]: INFO networking_nsxv3.common.synchronization [req-543e9912-8708-49cd-8145-c80f872b3b5c req-0b0f4105-8af7-4730-8d46-8c3da7c765c6 service nova] Enqueued Resource ID: 89358c9c-a651-4a30-bf54-cee1e44af9a9 with Priority: HIGHEST for action port [ 1170.066092] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_rules [ 1170.066092] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_members [ 1170.066092] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89358c9c-a651-4a30-bf54-cee1e44af9a9 with Priority: HIGHEST for action port [ 1170.066382] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.066492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.066585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.066812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.067033] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.069489] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f6b8a5b-bd24-49ea-96d6-51163d266deb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.069633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.069713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.069882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.070061] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.070258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.070321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.070501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.070595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.070903] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.071604] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-89358c9c-a651-4a30-bf54-cee1e44af9a9 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.073429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.073429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.073429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.073429] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89358c9c-a651-4a30-bf54-cee1e44af9a9',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.576725] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f6b8a5b-bd24-49ea-96d6-51163d266deb taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.576927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.577210] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.578411] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89358c9c-a651-4a30-bf54-cee1e44af9a9 with status ACTIVE [ 1170.578683] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.578841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.578956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.579271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.579395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.579648] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.579839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.579911] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.580242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.580242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.582158] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.582158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.582158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.582158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.582158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.582158] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89358c9c-a651-4a30-bf54-cee1e44af9a9 is going to be updated. [ 1170.595610] env[65630]: INFO networking_nsxv3.common.synchronization [req-1f87e983-782e-4b76-a890-09ad86602f00 req-92e31a85-06d9-40cf-a5e9-9fdee04126a6 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1170.597533] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1170.598027] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.598227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.598325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.598584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.599080] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.599080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.599080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.599404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.599404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.599552] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.609228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.611025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.611025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.611025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.611025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.611025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89358c9c-a651-4a30-bf54-cee1e44af9a9" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.934997] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1170.934997] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 deletion is rescheduled due to dependency. [ 1170.934997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.025878] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.026489] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.026652] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.026944] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.027240] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.027533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.027533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.027760] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.027891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.028120] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.028234] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.028337] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.028440] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.028547] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.028649] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.028780] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.054492] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.054492] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1171.054492] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.054492] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-180" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.054492] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-159152d4-4ec5-434f-8992-7ce5e13a32d7 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.054492] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.054492] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.054492] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.054492] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('159152d4-4ec5-434f-8992-7ce5e13a32d7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.083366] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.106024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.106024] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.106024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.106024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1171.136878] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.137088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.137174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.137437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.137584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.150675] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1171.557314] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.557518] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.557645] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.557928] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.558116] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.558278] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 159152d4-4ec5-434f-8992-7ce5e13a32d7 not found, creating... [ 1171.558541] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.558697] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.558814] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.559048] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.559190] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.559467] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.559620] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.559735] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.559940] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.560084] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.560224] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 159152d4-4ec5-434f-8992-7ce5e13a32d7 is going to be created. [ 1171.587405] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.587609] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.587775] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.588120] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.588383] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.588730] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.589684] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.589804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.590268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.590268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.590268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.590268] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb is going to be created. [ 1171.617627] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.617785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.617854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.618089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.618248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.631288] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb in Status: UNINITIALIZED for 2s [ 1172.318837] env[65630]: INFO networking_nsxv3.common.synchronization [req-1f87e983-782e-4b76-a890-09ad86602f00 req-14ebfea2-768c-4681-8b90-87457e99a14f service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 1172.319113] env[65630]: INFO networking_nsxv3.common.synchronization [req-1f87e983-782e-4b76-a890-09ad86602f00 req-14ebfea2-768c-4681-8b90-87457e99a14f service nova] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1172.319370] env[65630]: INFO networking_nsxv3.common.synchronization [req-1f87e983-782e-4b76-a890-09ad86602f00 req-14ebfea2-768c-4681-8b90-87457e99a14f service nova] Enqueued Resource ID: 159152d4-4ec5-434f-8992-7ce5e13a32d7 with Priority: HIGHEST for action port [ 1172.320479] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_rules [ 1172.320479] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1172.320479] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159152d4-4ec5-434f-8992-7ce5e13a32d7 with Priority: HIGHEST for action port [ 1172.320675] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.320798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.320923] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.321294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.321385] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.322273] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.323020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.324047] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-159152d4-4ec5-434f-8992-7ce5e13a32d7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.324172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.324461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.324461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.324461] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('159152d4-4ec5-434f-8992-7ce5e13a32d7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.826275] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.826445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.826676] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 159152d4-4ec5-434f-8992-7ce5e13a32d7 with status ACTIVE [ 1172.826899] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.827027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.827157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.827594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.827664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.828019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.828136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.828282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.828760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.828760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.828986] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.829165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.829276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.829522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.829677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.829865] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 159152d4-4ec5-434f-8992-7ce5e13a32d7 is going to be updated. [ 1172.854923] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.855137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.855206] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.855425] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.855563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.855729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-159152d4-4ec5-434f-8992-7ce5e13a32d7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.162810] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1173.163037] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 1173.163172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.163337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.163554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.163733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.163842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.163909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.164078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.164154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.164315] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.412166] env[65630]: INFO networking_nsxv3.common.synchronization [req-bcda4012-4b41-4880-8adc-f86d41a17452 req-a86edbfc-2f55-47e6-8b94-f2722ff886c4 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1173.412940] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1173.413287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.413287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.413415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.413546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.413710] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.413808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.413869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.414921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.415103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.415359] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.644484] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb in Status: SUCCESS [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.644484] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.644484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.644484] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.668175] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.920397] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.920397] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.920397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.920397] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1173.952451] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.952451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.952451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.952451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.952451] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.964337] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1174.146901] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.168974] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.649594] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f6b8a5b-bd24-49ea-96d6-51163d266deb: rpc.has_security_group_logging(os_id): False [ 1174.670909] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.671146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.671146] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.671367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.671446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.671724] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.671834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.671880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.672137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.672137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.672324] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb is going to be created. [ 1174.673522] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.673838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.674018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.674304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.674461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.674622] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1174.713506] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.713668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.713738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.713956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.714609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.725639] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1174.747538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.748356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.748356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.748356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.748530] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.764246] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb in Status: IN_PROGRESS for 2s [ 1175.978444] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1175.978444] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1175.978932] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.044138] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-ce19c000-2c34-4854-9087-93fee01dade3 tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1176.044138] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1176.044138] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.044138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.044138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.044138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.044138] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.045087] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.045220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.045401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.045493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.045591] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.404506] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.404754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.404882] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.405186] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.405455] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.405797] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.405797] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.405925] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.406137] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.406354] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.406467] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.406572] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.406700] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.406779] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.406882] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.407061] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.433949] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.434100] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1176.434268] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.434470] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.434806] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-82a89457-c640-4e00-9fb4-0cf536cf8c62 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.435086] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.435201] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.435540] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.435707] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a89457-c640-4e00-9fb4-0cf536cf8c62',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.548468] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.548666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.548718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.548955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.549170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.549401] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.549533] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.549609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.549754] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.549848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.549939] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1176.578536] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.578783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.578867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.579284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.579343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.591195] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1176.739267] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1176.739580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.739842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.740151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.740404] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.740581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.740677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.741291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.741291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.741291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.741291] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.778378] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb in Status: SUCCESS [ 1176.778804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.938435] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.938737] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.938876] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.939251] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.939437] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.939786] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 82a89457-c640-4e00-9fb4-0cf536cf8c62 not found, creating... [ 1176.940183] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.940382] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.940530] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.940908] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.941085] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.941401] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.941566] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.941699] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.942081] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.942140] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.942293] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 82a89457-c640-4e00-9fb4-0cf536cf8c62 is going to be created. [ 1176.974355] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.974589] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.974729] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.975254] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.975350] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.975638] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.243971] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.244371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.244371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.244455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.244616] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.244721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.244785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.244933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.245279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.245279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.245352] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.245433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.245493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.245639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.245781] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.245866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.245952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.246163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.246247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.246334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.246429] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.665343] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-4dd43e33-1bf4-48e0-8ad2-74189385a1b1 service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1177.665561] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-4dd43e33-1bf4-48e0-8ad2-74189385a1b1 service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1177.665700] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-4dd43e33-1bf4-48e0-8ad2-74189385a1b1 service nova] Enqueued Resource ID: 82a89457-c640-4e00-9fb4-0cf536cf8c62 with Priority: HIGHEST for action port [ 1177.666578] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1177.666677] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1177.666773] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82a89457-c640-4e00-9fb4-0cf536cf8c62 with Priority: HIGHEST for action port [ 1177.667236] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.667312] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.667355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.668136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.668136] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.669459] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.669610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.669858] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-82a89457-c640-4e00-9fb4-0cf536cf8c62 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.669974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.670123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.670256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.670335] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a89457-c640-4e00-9fb4-0cf536cf8c62',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.748633] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14b62121-4e0b-44ce-9aab-8ed6b4024ea4: rpc.has_security_group_logging(os_id): False [ 1177.769566] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.769761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.769830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.770064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.770169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.770357] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.770452] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.770512] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.770669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.770744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.770938] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.771063] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.771098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.771246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.771387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.771586] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.771681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.771743] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.771884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.771967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.772085] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1177.832510] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.832721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.832721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.833080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.833255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.847342] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1178.171955] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82a89457-c640-4e00-9fb4-0cf536cf8c62 with status ACTIVE [ 1178.172298] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.172472] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.172545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.172835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.172953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.173155] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.173280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.173347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.173505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.173598] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.173785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.173882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.173941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.174093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.174168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.174252] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82a89457-c640-4e00-9fb4-0cf536cf8c62 is going to be updated. [ 1178.175466] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.175556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.197478] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.197620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.197692] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.198194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.198194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.198194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82a89457-c640-4e00-9fb4-0cf536cf8c62" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.452526] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-553dc913-8146-4cbc-a99e-8bd8c57b4bec tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1178.453836] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1178.453836] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.453836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.602412] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1178.602683] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 deletion is rescheduled due to dependency. [ 1178.603089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.603724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.603724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.603895] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.604474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.604610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.604849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.604957] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.605232] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.805405] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.805628] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.805826] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.806298] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.806782] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.807769] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.807769] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.807769] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.807924] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.808181] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.808377] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.808611] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.808868] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.809404] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.809688] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.809688] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.830523] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.830596] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.832894] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.832894] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-837" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.832894] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-f764348c-00bc-43cb-b599-7fd0fe70df1a taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.832894] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.832894] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.832894] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.832894] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f764348c-00bc-43cb-b599-7fd0fe70df1a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.109316] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.336102] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.336102] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.336351] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.336533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.336733] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.336904] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port f764348c-00bc-43cb-b599-7fd0fe70df1a not found, creating... [ 1179.337202] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.337383] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.337507] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.337768] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.337985] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.338276] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.338463] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.338823] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.338883] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.338974] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.339185] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: f764348c-00bc-43cb-b599-7fd0fe70df1a is going to be created. [ 1179.361392] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.361636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.361715] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.362208] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.362279] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.362525] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.612556] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.867317] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1179.867656] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.077693] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-18870f12-1399-4845-8600-74b781e36fa6 service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1180.077930] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-18870f12-1399-4845-8600-74b781e36fa6 service nova] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1180.078080] env[65630]: INFO networking_nsxv3.common.synchronization [req-b136454e-20dc-468c-a847-eb1b3b7637e2 req-18870f12-1399-4845-8600-74b781e36fa6 service nova] Enqueued Resource ID: f764348c-00bc-43cb-b599-7fd0fe70df1a with Priority: HIGHEST for action port [ 1180.078747] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_rules [ 1180.078948] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1180.079040] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f764348c-00bc-43cb-b599-7fd0fe70df1a with Priority: HIGHEST for action port [ 1180.079347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.079453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.079681] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.079783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.080185] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f764348c-00bc-43cb-b599-7fd0fe70df1a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.080185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.080185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.080424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.080424] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f764348c-00bc-43cb-b599-7fd0fe70df1a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.115687] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.119114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.119114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.119114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.119114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.119114] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1180.161193] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.161412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.161514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.162068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.162068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.183856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1180.582298] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f764348c-00bc-43cb-b599-7fd0fe70df1a with status ACTIVE [ 1180.582537] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.582677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.582745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.582979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.583351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.583351] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.583484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.583484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.583584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.583661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.583839] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.583933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.584016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.584163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.584239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.584400] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f764348c-00bc-43cb-b599-7fd0fe70df1a is going to be updated. [ 1180.610037] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.610037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.610037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.610037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.610037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.610037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f764348c-00bc-43cb-b599-7fd0fe70df1a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.897946] env[65630]: INFO networking_nsxv3.common.synchronization [req-b9f09259-337a-4a2b-b8d5-3c6a00d1086a req-c42e1969-17b4-4c79-a330-582f4cfaa553 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1180.898647] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1180.898961] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.899110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.899230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.899376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.899538] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.899631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.899694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.899842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.899926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.900052] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.254885] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.255452] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.255780] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.256220] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.256646] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.256951] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.257256] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.257519] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.257673] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.257899] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.258042] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.258192] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.258316] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.258436] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.258571] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.258710] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.282728] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.282880] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1181.284059] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.284059] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.284059] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-f1c521c1-7f90-411c-b820-658d3e3d7158 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.284059] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.284059] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.284361] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.284361] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1c521c1-7f90-411c-b820-658d3e3d7158',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.403348] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.786920] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.787288] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.787441] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.787740] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.787895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.788107] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port f1c521c1-7f90-411c-b820-658d3e3d7158 not found, creating... [ 1181.788507] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.788762] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.788928] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.789302] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.789564] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.790138] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.790332] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.790454] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.790710] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.790891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.791066] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: f1c521c1-7f90-411c-b820-658d3e3d7158 is going to be created. [ 1181.813680] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.813995] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.814218] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.814535] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.815894] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.816277] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.906844] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.197077] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1182.197077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.197420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.197488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.197736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.197876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.197967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.198191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.198284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.198374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.198474] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.200274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.200274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.200274] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.200274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.200274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.200274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.200274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.200689] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.409471] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.409863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.410140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.410477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.411166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.411166] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1182.443309] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.443624] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.444132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.446020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.446020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.455029] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1182.533790] env[65630]: INFO networking_nsxv3.common.synchronization [req-b9f09259-337a-4a2b-b8d5-3c6a00d1086a req-d12a5148-d499-438e-813a-5f152f8bc460 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1182.533967] env[65630]: INFO networking_nsxv3.common.synchronization [req-b9f09259-337a-4a2b-b8d5-3c6a00d1086a req-d12a5148-d499-438e-813a-5f152f8bc460 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1182.534121] env[65630]: INFO networking_nsxv3.common.synchronization [req-b9f09259-337a-4a2b-b8d5-3c6a00d1086a req-d12a5148-d499-438e-813a-5f152f8bc460 service nova] Enqueued Resource ID: f1c521c1-7f90-411c-b820-658d3e3d7158 with Priority: HIGHEST for action port [ 1182.534646] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1182.534803] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1182.534872] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1c521c1-7f90-411c-b820-658d3e3d7158 with Priority: HIGHEST for action port [ 1182.535485] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.535539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.535588] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.536662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.536662] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.538114] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.538215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.538423] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1c521c1-7f90-411c-b820-658d3e3d7158 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.538524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.538589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.538999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.538999] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1c521c1-7f90-411c-b820-658d3e3d7158',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.704518] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.704731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.704850] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.039530] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.039845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.041046] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1c521c1-7f90-411c-b820-658d3e3d7158 with status ACTIVE [ 1183.041277] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.041395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.041471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.041800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.041800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.041947] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.042020] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.042079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.042263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.042327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.042513] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.042618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.042683] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.042806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.042944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.043082] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1c521c1-7f90-411c-b820-658d3e3d7158 is going to be updated. [ 1183.071281] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.071461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.072882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.072882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.072882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.072882] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1c521c1-7f90-411c-b820-658d3e3d7158" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.207779] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.710970] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.711157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.711232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.711456] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.711548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.711646] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1183.755579] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.755579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.755742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.755903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.756114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.766122] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1184.436359] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2911ded-82ca-42fe-a51b-888360d48e6f req-86ebafc7-51de-4f59-885b-376e52cd110b tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1184.436995] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1184.437715] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.437715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.437715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.437855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.438482] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.438482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.438482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.438482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.438482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.438482] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.645642] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1184.645642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.645642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.645642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.645642] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.645642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.645642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.645642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.645642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.645642] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.797400] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.797639] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.797764] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.798035] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.798722] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.798722] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.798722] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.798904] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.798939] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.799146] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.799242] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.799344] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.799443] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.799560] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.799660] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.799784] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.817824] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.817991] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1184.818149] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.818327] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.818647] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-9504a57d-d0a6-4914-8306-c0438639f9b7 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.818821] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.818937] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.819292] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.819428] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9504a57d-d0a6-4914-8306-c0438639f9b7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.941153] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.147214] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.323891] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.323891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.323891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.323891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.323891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.323891] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 9504a57d-d0a6-4914-8306-c0438639f9b7 not found, creating... [ 1185.323891] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.323891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.323891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.323891] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.324624] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.325088] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.325431] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.325659] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.325969] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.326345] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.326637] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 9504a57d-d0a6-4914-8306-c0438639f9b7 is going to be created. [ 1185.348271] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.349032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.349148] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.349514] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.349883] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.350489] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.404286] env[65630]: INFO networking_nsxv3.common.synchronization [req-33373f02-a722-4ba1-b1a8-e416e519a83c req-6aac466b-632f-41f3-9e95-8931282e7619 tempest-ServerDiskConfigTestJSON-1263822110 tempest-ServerDiskConfigTestJSON-1263822110-project-member] Enqueued Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1185.404933] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 with Priority: HIGHEST for action security_group_members [ 1185.405336] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.405516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.405626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.405893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.406333] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.406454] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.406542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.406814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.406960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.407149] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14b62121-4e0b-44ce-9aab-8ed6b4024ea4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.443515] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.649399] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.787815] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1185.790029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.790029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.790029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.790029] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.790029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.790029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.790029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.790029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.790029] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.909564] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.910649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.910649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.910649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.910649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.910649] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.910649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.910978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.910978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.911128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.911248] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 is going to be updated. [ 1185.945888] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.946380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.946436] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.946766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.946766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.946980] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1185.950567] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.950567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.950567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.950567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.950567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.962714] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: IN_PROGRESS for 2s [ 1185.994601] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.994820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.994820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.995099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.995369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.007687] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1186.152370] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.152540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.152611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.152841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.152933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.153061] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1186.181882] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.182169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.182292] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.182668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.182925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.192675] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1186.293065] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.564471] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2911ded-82ca-42fe-a51b-888360d48e6f req-d9d324ea-d694-47be-90a3-8eeab9fe68ea service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1186.565932] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2911ded-82ca-42fe-a51b-888360d48e6f req-d9d324ea-d694-47be-90a3-8eeab9fe68ea service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1186.566179] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2911ded-82ca-42fe-a51b-888360d48e6f req-d9d324ea-d694-47be-90a3-8eeab9fe68ea service nova] Enqueued Resource ID: 9504a57d-d0a6-4914-8306-c0438639f9b7 with Priority: HIGHEST for action port [ 1186.566991] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1186.567167] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1186.567332] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9504a57d-d0a6-4914-8306-c0438639f9b7 with Priority: HIGHEST for action port [ 1186.568889] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.570221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.570540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.570854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.575253] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.575253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.575253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.575253] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-9504a57d-d0a6-4914-8306-c0438639f9b7 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.575253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.575253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.575253] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.575253] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9504a57d-d0a6-4914-8306-c0438639f9b7',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.796654] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.031362] env[65630]: INFO networking_nsxv3.common.synchronization [req-7d07b9f7-d3d2-477c-bacc-b73e64d85868 req-c3caa14d-4eaf-4b25-ab7f-3cb415caeca1 tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1187.031878] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1187.032358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.032499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.033072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.033072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.033072] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.033072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.033346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.033346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.033346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.033485] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.077811] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9504a57d-d0a6-4914-8306-c0438639f9b7 with status ACTIVE [ 1187.078185] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.078389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.078486] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.078731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.078830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.079026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.079151] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.079220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.079334] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.079411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.079612] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.079706] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.079763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.079904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.079977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.080074] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9504a57d-d0a6-4914-8306-c0438639f9b7 is going to be updated. [ 1187.081227] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.081322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.102623] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.103111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.103111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.103111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.103304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.103468] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9504a57d-d0a6-4914-8306-c0438639f9b7" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.298677] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.300081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.300081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.300081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.300081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.300081] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1187.339825] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.340121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.340223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.340680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.340680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.356584] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1187.536057] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.536249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.536325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.536594] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.536686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.536898] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.537068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.537122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.537243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.537337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.537422] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1187.568992] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.570088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.570088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.570088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.570244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.580518] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1187.973562] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 in Status: SUCCESS [ 1187.973733] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14b62121-4e0b-44ce-9aab-8ed6b4024ea4 deletion is rescheduled due to dependency. [ 1187.973839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14b62121-4e0b-44ce-9aab-8ed6b4024ea4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.017077] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1188.017321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.017498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.017720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.017907] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.018038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.018099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.018256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.018353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.018425] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.205074] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1188.205342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.205525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.205778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.205974] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.206112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.206185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.206519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.206519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.206519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.206605] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.520185] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.709466] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.710226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.710226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.710226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.710226] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.710474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.710474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.710575] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.710643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.710775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.710957] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.711126] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.711126] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.711419] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.711419] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.711715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.711715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.711931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.711931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.711931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.712088] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.023069] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.216463] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed098d0-aa55-4a88-be4f-3fe063ee74f6: rpc.has_security_group_logging(os_id): False [ 1189.235595] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.235800] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.235886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.236158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.236358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.236591] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.236718] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.236815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.237093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.237241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.237500] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.237614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.237702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.237868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.237973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.238240] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.238343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.238407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.238555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.238641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.238743] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1189.302768] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.302768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.302768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.303054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.303245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.318188] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1189.370430] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1189.370641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.370713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.370995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.371229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.371388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.371453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.371649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.371737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.371821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.371995] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.372114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.372170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.372358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.372563] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.372671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.372727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.372869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.372948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.373040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.373138] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.525689] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.525898] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.525939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.526241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.526374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.526472] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1189.560535] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.560774] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.560836] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.561157] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.561339] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.572688] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1189.591353] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1189.591540] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 deletion is rescheduled due to dependency. [ 1189.592023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.875467] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adaa915d-681a-4aa6-acf8-0488514134f3: rpc.has_security_group_logging(os_id): False [ 1189.897924] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.898142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.898217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.898467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.898563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.898775] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.898874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.898931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.899127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.899179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.899378] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.899475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.899554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.899740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.899794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.899959] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.900079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.900145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.900275] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.900346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.900434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1189.978047] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.978047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.978047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.978430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.978430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.996280] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1191.332472] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1191.332866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.584972] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1191.585395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.585600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.585969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.586157] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.586327] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.586426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.586614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.586733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.586917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.587053] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.873532] env[65630]: INFO networking_nsxv3.common.synchronization [req-525bd5eb-61f6-4f07-bde2-229c4aeb84db req-5c3c3c6b-5992-4489-9099-a51c1aacc2eb tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1191.873765] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1191.874103] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.874230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.874299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.874674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.874674] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.874795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.874795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.874941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.875036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.875127] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.013286] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1192.013584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.013823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.014112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.014228] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.090171] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.090409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.090409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.090681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.090870] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.090975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.091049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.091200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.091289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.091377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.091537] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.091639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.091698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.091846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.091985] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.092092] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.092193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.092407] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.092494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.092580] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.092703] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.377890] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.379836] env[65630]: INFO networking_nsxv3.common.synchronization [req-24012640-a4cd-46fc-8399-c1957b4f320c req-7723d8cc-cdb4-4b7a-ab12-c08a4eee928f tempest-MultipleCreateTestJSON-1731872063 tempest-MultipleCreateTestJSON-1731872063-project-member] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1192.380871] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGHEST for action security_group_members [ 1192.381122] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.381230] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.462931] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed39f65a-f724-43b7-b435-cecb2a74e04f req-fcfa829d-40ae-4622-8e86-2e7cbaa805be tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1192.463626] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1192.464302] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.464302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.464302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.464482] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.464482] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.464553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.464627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.464757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.464869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.464968] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.516488] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.517028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.594931] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d84857eb-b557-4aa2-8d62-34137b9cab1f: rpc.has_security_group_logging(os_id): False [ 1192.616785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.616917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.616966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.617294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.617385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.617640] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.617748] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.617811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.617974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.618075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.621026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.621026] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.621026] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.621026] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1192.689397] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.689397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.689397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.689397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.689675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.704480] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1192.836044] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.836392] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.836609] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.836907] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.837244] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.837505] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.837717] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.838081] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.838347] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.838690] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.838985] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.839232] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.839453] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.839688] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.839911] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.840173] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.859382] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.859622] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1192.859700] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.859973] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.860349] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-2f08c43d-0816-4491-892d-f4053fbaa4f0 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.860520] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.860649] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.861189] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.861426] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f08c43d-0816-4491-892d-f4053fbaa4f0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.881064] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.967632] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.363798] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.364110] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.364266] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.364590] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.364781] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.364984] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 2f08c43d-0816-4491-892d-f4053fbaa4f0 not found, creating... [ 1193.365427] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.365603] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.365776] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.366058] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.366216] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.366551] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.366786] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.366927] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.367180] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.367332] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.367494] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 2f08c43d-0816-4491-892d-f4053fbaa4f0 is going to be created. [ 1193.383783] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.384170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.384170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.384303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.384448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.384594] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1193.392941] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.393213] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.393363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.393726] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.393959] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.394258] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.415734] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.415970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.415970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.416199] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.416337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.429655] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1193.469449] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.972541] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.972717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.972841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.973015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.973118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.973985] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be updated. [ 1194.010509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.010714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.010946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.011604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.011604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.023351] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: IN_PROGRESS for 2s [ 1194.657351] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed39f65a-f724-43b7-b435-cecb2a74e04f req-eb9cf33d-fb4a-4807-9351-9bbc9400a213 service nova] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1194.657639] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed39f65a-f724-43b7-b435-cecb2a74e04f req-eb9cf33d-fb4a-4807-9351-9bbc9400a213 service nova] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1194.657961] env[65630]: INFO networking_nsxv3.common.synchronization [req-ed39f65a-f724-43b7-b435-cecb2a74e04f req-eb9cf33d-fb4a-4807-9351-9bbc9400a213 service nova] Enqueued Resource ID: 2f08c43d-0816-4491-892d-f4053fbaa4f0 with Priority: HIGHEST for action port [ 1194.658486] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_rules [ 1194.658634] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1194.658740] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08c43d-0816-4491-892d-f4053fbaa4f0 with Priority: HIGHEST for action port [ 1194.659088] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.659205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.659245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.659441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.659526] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.660502] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.660601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.661162] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f08c43d-0816-4491-892d-f4053fbaa4f0 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.661279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.661351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.661548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.661635] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f08c43d-0816-4491-892d-f4053fbaa4f0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.723785] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1194.724043] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.165830] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.165991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.170454] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f08c43d-0816-4491-892d-f4053fbaa4f0 with status ACTIVE [ 1195.170767] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.170968] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.171105] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.171432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.171589] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.171857] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.172045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.172162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.172386] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.172539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.172851] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.173040] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.173385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.173385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.174156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.174156] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f08c43d-0816-4491-892d-f4053fbaa4f0 is going to be updated. [ 1195.200813] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.201023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.201023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.201636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.201636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.201636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f08c43d-0816-4491-892d-f4053fbaa4f0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.440940] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1195.441246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.441564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.441837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.441928] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.442019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.442064] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.442202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.442288] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.442378] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.944543] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.944837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.944837] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.945048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.945155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.945441] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.945599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.945599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.946091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.946091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.946091] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1195.975466] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.975466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.975466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.975466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.975466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.984203] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1196.033942] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: SUCCESS [ 1196.033942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.034183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.034358] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.034556] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.034666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.034732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.034892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.034971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.035077] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.538114] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.041451] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.545472] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.545640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.545705] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.545944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.546051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.546158] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be updated. [ 1197.573821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.574033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.574033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.574258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.574404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.585967] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: IN_PROGRESS for 2s [ 1197.997313] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1197.997486] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 deletion is rescheduled due to dependency. [ 1197.997604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.997794] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.998035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.998226] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.998342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.998435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.998596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.998674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.998758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.998845] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.502664] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.503119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.503119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.503375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.503607] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.503724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.503912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.504191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.504317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.504432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.504626] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.504755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.504819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.504974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.505163] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.505258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.505390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.505647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.505739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.505846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.505941] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.009159] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adaa915d-681a-4aa6-acf8-0488514134f3: rpc.has_security_group_logging(os_id): False [ 1199.032852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.033080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.033080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.033272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.033375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.033591] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.033702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.033776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.033946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.034028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.034211] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.034321] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.034393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.034540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.034615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.034806] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.034885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.034943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.035094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.035168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.035252] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be updated. [ 1199.102446] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.102446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.102446] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.102677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.102677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.118442] env[65630]: INFO networking_nsxv3.common.synchronization [req-1b10c1fd-8fe4-4253-849b-1cf873936964 req-5b7595d3-ef67-4e01-b401-88a58ba27b39 tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1199.119390] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: IN_PROGRESS for 2s [ 1199.119822] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1199.120186] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.120303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.120366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.120562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.120717] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.120862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.120862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.121024] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.121102] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.121199] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.468803] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.470013] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.470013] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.470013] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.470013] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.470305] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.470305] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.470495] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.470634] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.470831] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.470936] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.471048] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.471152] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.471254] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.471404] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.471534] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.500673] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.500842] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.501058] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.501284] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-425" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.501640] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-626d0ed8-211d-442e-b115-6c65dca137d4 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.501871] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.502010] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.502380] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.502546] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('626d0ed8-211d-442e-b115-6c65dca137d4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.594014] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: SUCCESS [ 1199.594307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.594467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.594766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.595054] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.595249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.595326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.595543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.595652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.595724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.595826] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.625891] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.626166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.626166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.626467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.626570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.626751] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.626852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.626909] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.627081] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.627156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.627243] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1199.655746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.655950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.655950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.656287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.656402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.666845] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1200.007589] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.007830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.007996] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.008385] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.008607] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.008795] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 626d0ed8-211d-442e-b115-6c65dca137d4 not found, creating... [ 1200.009167] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.009396] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.009543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.009838] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.010124] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.010426] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.010632] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.010792] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.011074] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.011254] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.011443] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 626d0ed8-211d-442e-b115-6c65dca137d4 is going to be created. [ 1200.032878] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.033174] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.033349] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.033765] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.034155] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.034483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.097845] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.600048] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d30328a0-3fe7-4b9c-8fb4-3748bb068910: rpc.has_security_group_logging(os_id): False [ 1200.620925] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.620925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.620925] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.621189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.621189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.621413] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.621508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.621556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.621694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.621768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.621858] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be updated. [ 1200.688743] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.688953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.688953] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.689188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.689333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.705027] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: IN_PROGRESS for 2s [ 1200.726641] env[65630]: INFO networking_nsxv3.common.synchronization [req-1b10c1fd-8fe4-4253-849b-1cf873936964 req-bc4ae30b-3eb1-40fd-b0ee-835f5d52e5c5 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1200.726816] env[65630]: INFO networking_nsxv3.common.synchronization [req-1b10c1fd-8fe4-4253-849b-1cf873936964 req-bc4ae30b-3eb1-40fd-b0ee-835f5d52e5c5 service nova] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1200.726950] env[65630]: INFO networking_nsxv3.common.synchronization [req-1b10c1fd-8fe4-4253-849b-1cf873936964 req-bc4ae30b-3eb1-40fd-b0ee-835f5d52e5c5 service nova] Enqueued Resource ID: 626d0ed8-211d-442e-b115-6c65dca137d4 with Priority: HIGHEST for action port [ 1200.727508] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_rules [ 1200.727648] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1200.727770] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626d0ed8-211d-442e-b115-6c65dca137d4 with Priority: HIGHEST for action port [ 1200.728554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.729162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.729162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.729162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.729162] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.730112] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.730266] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.730500] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-626d0ed8-211d-442e-b115-6c65dca137d4 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.730663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.730725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.731846] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.731846] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('626d0ed8-211d-442e-b115-6c65dca137d4',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.733593] env[65630]: INFO networking_nsxv3.common.synchronization [req-b83dd8b4-2f22-41e1-bad4-9ace807ec4ed req-70acccb2-24bc-4a79-9b89-8e1fe279f0c5 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1200.734232] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1200.735978] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.735978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.735978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.735978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.735978] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.735978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.735978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.735978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.735978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.735978] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.141980] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adaa915d-681a-4aa6-acf8-0488514134f3 in Status: SUCCESS [ 1201.141980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.232940] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.233375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.234914] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 626d0ed8-211d-442e-b115-6c65dca137d4 with status ACTIVE [ 1201.235210] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.235364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.235462] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.236023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.236023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.236023] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.236158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.236158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.236274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.236347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.236565] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.236622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.236681] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.237582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.237582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.237582] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 626d0ed8-211d-442e-b115-6c65dca137d4 is going to be updated. [ 1201.238188] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.262116] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.262271] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.262317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.262525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.262680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.262840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-626d0ed8-211d-442e-b115-6c65dca137d4" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.483769] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c0305cb-a413-4ba4-b26a-600de6d14562 req-31f53ed9-2bb8-4e1b-bfb3-02497c42bc8b tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1201.484673] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1201.487872] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.487872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.487872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.487872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.487872] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.487872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.487872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.487872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.487872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.487872] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.621236] env[65630]: INFO networking_nsxv3.common.synchronization [req-9eb1e9ed-b387-4e77-ab79-e02c3b6d18ec req-09268eff-97de-4e8e-ad46-eac875b7adac tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1201.622141] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1201.623235] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.623505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.623647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.623980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.624369] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.624491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.624685] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.625308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.625614] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.625802] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.681688] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1201.681975] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1201.682162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.682769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.683793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.684167] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.684391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.684965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.684965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.684965] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.685159] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.740527] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.850037] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.850037] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.850263] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.850626] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.850626] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.850881] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.850936] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.855430] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.855707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.855950] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.856488] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.856690] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.856812] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.856931] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.857050] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.857228] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.880671] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.880844] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1201.880990] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.881202] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.881534] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.881711] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.881830] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.882214] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.882832] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0009f2c7-8ccf-4de5-9472-3adfdfcae5c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.990659] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.991113] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.992630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.992630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.992630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.992630] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.992630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.992630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.992630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.992630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.992630] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1202.022452] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.022657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.022751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.022981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.023169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.036172] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1202.129791] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.189036] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.243327] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.243552] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.243599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.243832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.243937] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.244050] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1202.274355] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.274519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.274596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.274839] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.274988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.284733] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1202.385733] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.386037] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.386173] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.386468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.386616] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.386777] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 not found, creating... [ 1202.387079] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.387249] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.387363] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.387642] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.387809] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.388129] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.388287] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.388433] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.388669] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.388798] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.388935] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 is going to be created. [ 1202.412752] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.413277] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.413277] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.413488] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.413733] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.413992] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.631035] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.692331] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.719088] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: SUCCESS [ 1202.719411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.133708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.133708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.133708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.133941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.133994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.134076] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1203.159410] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c0305cb-a413-4ba4-b26a-600de6d14562 req-b88ef013-d12c-4532-a0cf-e07ec0d9cce9 service nova] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 1203.159627] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c0305cb-a413-4ba4-b26a-600de6d14562 req-b88ef013-d12c-4532-a0cf-e07ec0d9cce9 service nova] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1203.159792] env[65630]: INFO networking_nsxv3.common.synchronization [req-2c0305cb-a413-4ba4-b26a-600de6d14562 req-b88ef013-d12c-4532-a0cf-e07ec0d9cce9 service nova] Enqueued Resource ID: 0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 with Priority: HIGHEST for action port [ 1203.160602] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 1203.160808] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1203.160907] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 with Priority: HIGHEST for action port [ 1203.162526] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.162724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.162818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.163855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.163855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.165300] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.165542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.165576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.165815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.165920] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.166949] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.167046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.167256] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.167355] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.167420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.167595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.167671] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0009f2c7-8ccf-4de5-9472-3adfdfcae5c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.182048] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1203.195089] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.195477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.195477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.195721] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.195848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.195919] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1203.238159] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.238332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.238483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.238628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.238913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.252076] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1203.670471] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.670792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.670858] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 with status ACTIVE [ 1203.671090] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.671229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.671298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.671515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.671606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.671776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.671872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.671935] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.672109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.672192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.672402] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.672506] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.672592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.672733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.672786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.672864] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0009f2c7-8ccf-4de5-9472-3adfdfcae5c3 is going to be updated. [ 1203.697952] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.698161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.698161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.698421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.698574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.698732] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0009f2c7-8ccf-4de5-9472-3adfdfcae5c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.047218] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1204.048088] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 deletion is rescheduled due to dependency. [ 1204.048088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.048088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.048508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.048508] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.048508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.048660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.048660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.048735] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.048835] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.295788] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1204.296152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.551255] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.053821] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.193032] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1205.193032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.263877] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1205.263877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.263877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.264164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.264164] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.264328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.264370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.264547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.264672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.264672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.264787] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.556842] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.557046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.557127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.557367] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.557453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.557557] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1205.593780] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.593780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.593780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.593780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.593780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.605515] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1205.769196] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.770994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.770994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.770994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.772106] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.772106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.772106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.772106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.772106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.772106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.772106] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.274975] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71bd905-a59a-420e-96dc-4f48e2b11e86: rpc.has_security_group_logging(os_id): False [ 1206.297164] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.297414] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.297466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.297717] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.297852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.299156] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.299156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.299156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.299156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.299156] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.299156] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.299447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.299447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.299625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.299733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.300067] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.300214] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.300302] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.300555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.300983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.300983] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1206.427803] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.428218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.428218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.428405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.428450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.457749] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1207.039051] env[65630]: INFO networking_nsxv3.common.synchronization [None req-8d3ace8e-0902-4b3f-b971-d186415673e9 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1207.039655] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1207.039971] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.040112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.040185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.040364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.040524] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.040646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.040682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.040875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.040875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.041159] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.550109] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.550416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.550416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.550528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.550603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.550815] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.550912] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.550971] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.551139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.551218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.551307] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1207.586062] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.586258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.586324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.586515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.586658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.598984] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1207.618447] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1207.618813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.619125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.619505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.619805] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.620037] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.620179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.620467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.620667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.620793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.620969] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.125714] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.176623] env[65630]: INFO networking_nsxv3.common.synchronization [req-a3e2b19a-b8a0-4041-87b2-bbb25dbb718f req-7f3dccb3-3977-4c13-9446-b8b2ebf37206 tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1208.177564] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1208.178045] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.178161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.178254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.178521] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.178711] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.178854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.178929] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.179123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.179320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.179460] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.473644] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1208.473981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.537682] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.537955] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.538181] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.538468] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.538791] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.539165] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.539326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.539641] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.539825] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.540057] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.540366] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.540446] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.540502] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.540611] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.540716] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.540861] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.561247] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.561688] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.561688] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.561851] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.562229] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-cc17cda7-fd03-4178-a8a2-f0215753c05f taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.562474] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.562633] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.562957] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.563173] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc17cda7-fd03-4178-a8a2-f0215753c05f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.631107] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bee721e8-67ba-4959-8884-95efeb9d52b8: rpc.has_security_group_logging(os_id): False [ 1208.651338] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.651534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.651581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.651773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.651864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.652127] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.652267] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.652319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.652450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.652525] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.652614] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1208.682714] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.682928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.682928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.683189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.683282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.683493] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.683584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.683646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.683818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.683880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.684015] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1208.716966] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.717177] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.717219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.717455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.717612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.719490] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.719608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.719672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.719850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.719988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.733948] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1208.744831] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1209.066149] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.066409] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.066612] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.066936] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.067105] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.067273] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port cc17cda7-fd03-4178-a8a2-f0215753c05f not found, creating... [ 1209.067565] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.067741] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.067861] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.068112] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.068259] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.068702] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.069228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.069228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.069608] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.069789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.071101] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: cc17cda7-fd03-4178-a8a2-f0215753c05f is going to be created. [ 1209.094719] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.094719] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.095117] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.095117] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.095983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.095983] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.611037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1209.611387] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 deletion is rescheduled due to dependency. [ 1209.611387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.852315] env[65630]: INFO networking_nsxv3.common.synchronization [req-a3e2b19a-b8a0-4041-87b2-bbb25dbb718f req-5cae1e3a-bdac-4c9e-a9ef-29f16954b66a service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 1209.852631] env[65630]: INFO networking_nsxv3.common.synchronization [req-a3e2b19a-b8a0-4041-87b2-bbb25dbb718f req-5cae1e3a-bdac-4c9e-a9ef-29f16954b66a service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1209.852876] env[65630]: INFO networking_nsxv3.common.synchronization [req-a3e2b19a-b8a0-4041-87b2-bbb25dbb718f req-5cae1e3a-bdac-4c9e-a9ef-29f16954b66a service nova] Enqueued Resource ID: cc17cda7-fd03-4178-a8a2-f0215753c05f with Priority: HIGHEST for action port [ 1209.853909] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 1209.853909] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1209.854041] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc17cda7-fd03-4178-a8a2-f0215753c05f with Priority: HIGHEST for action port [ 1209.854472] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.854658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.854785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.855269] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.855269] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.856473] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.856783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.856868] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc17cda7-fd03-4178-a8a2-f0215753c05f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.857023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.857088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.857528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.857528] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc17cda7-fd03-4178-a8a2-f0215753c05f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.360527] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.360767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.361040] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc17cda7-fd03-4178-a8a2-f0215753c05f with status ACTIVE [ 1210.361339] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.361529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.361644] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.364085] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.364085] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.364085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.365048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.365048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.365048] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc17cda7-fd03-4178-a8a2-f0215753c05f is going to be updated. [ 1210.392736] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.392900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.393752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.393752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.393752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.393752] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.746124] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1210.746510] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 deletion is rescheduled due to dependency. [ 1210.746510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.747484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.747695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.747872] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.747984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.748106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.748220] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.748307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.748392] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.762821] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1210.763115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.251895] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.754465] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.257457] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.257627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.257701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.257972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.258077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.258178] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1212.289354] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.289611] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.289708] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.290062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.290185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.300651] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1214.313525] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1214.313908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.314045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.314337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.314539] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.314664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.314730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.314934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.315067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.315338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.315338] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.324564] env[65630]: INFO networking_nsxv3.common.synchronization [req-6cb99469-0ea0-43ea-b64c-b34d2bae07f1 req-120287ac-60a9-4677-be04-5e214160e1ec tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1214.325085] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1214.325344] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.325465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.325560] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.325810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.326048] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.326201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.326307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.326513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.327660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.327660] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.817082] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.829166] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.829326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.829412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.829640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.829767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.830009] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.830137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.830204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.830393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.830485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.830574] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1214.857721] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.857947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.857947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.858181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.858328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.867039] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1215.319744] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397b25ae-6929-46ce-8711-37502e4943b3: rpc.has_security_group_logging(os_id): False [ 1215.340570] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.340775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.340775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.341120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.341246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.341605] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.341724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.341781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.341945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.342348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.342348] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1215.451042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.451235] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.451396] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.451630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.451780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.467151] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1215.856224] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.856419] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.856543] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.856842] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.857114] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.857285] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.857417] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.857707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.857896] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.858157] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.858309] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.858497] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.858683] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.858890] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.859075] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.859299] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1215.883890] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1215.884079] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1215.884223] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1215.884404] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.884735] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-507d1b0c-d574-4980-9713-8858c00943ae taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.884915] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.885068] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.885433] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.885608] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('507d1b0c-d574-4980-9713-8858c00943ae',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.388091] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.388503] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.388503] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.388687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.388873] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.389038] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 507d1b0c-d574-4980-9713-8858c00943ae not found, creating... [ 1216.389280] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.389437] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.389555] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.389779] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.389919] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.390297] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.390427] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.390556] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.390664] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.390796] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.390931] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 507d1b0c-d574-4980-9713-8858c00943ae is going to be created. [ 1216.412268] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.412541] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.412606] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.412880] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.413117] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.413342] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.551782] env[65630]: INFO networking_nsxv3.common.synchronization [req-814a0c43-9ea2-4d40-a3a1-9cddd500a329 req-a0ea9da5-3fb5-4725-b4f6-f8021e467e54 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1216.552477] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1216.552758] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.552888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.552956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.556045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.556277] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.556405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.556555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.556745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.556849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.556957] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.853554] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.853824] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.853978] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.854267] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.856532] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.856532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.857680] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.857680] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.857680] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.857680] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.857680] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.857680] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.858238] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.858238] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.858238] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.858238] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.878790] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1216.878979] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 deletion is rescheduled due to dependency. [ 1216.879124] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.880468] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.880683] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1216.880861] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.881082] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-260" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.881445] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.881659] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.881793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.882358] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.882430] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82a3d32-d47f-4b52-8f0a-775eaf1cf481',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.058960] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.153161] env[65630]: INFO networking_nsxv3.common.synchronization [req-6610473b-344f-42da-b3c8-4c3b29100d1c req-a996e110-82f9-4f5d-b8c2-71f32d6c5286 service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1217.153630] env[65630]: INFO networking_nsxv3.common.synchronization [req-6610473b-344f-42da-b3c8-4c3b29100d1c req-a996e110-82f9-4f5d-b8c2-71f32d6c5286 service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1217.153630] env[65630]: INFO networking_nsxv3.common.synchronization [req-6610473b-344f-42da-b3c8-4c3b29100d1c req-a996e110-82f9-4f5d-b8c2-71f32d6c5286 service nova] Enqueued Resource ID: 507d1b0c-d574-4980-9713-8858c00943ae with Priority: HIGHEST for action port [ 1217.154043] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1217.154186] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1217.154280] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 507d1b0c-d574-4980-9713-8858c00943ae with Priority: HIGHEST for action port [ 1217.154584] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.154655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.154727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.154940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.154994] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.155938] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.156048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.156120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.156282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.156433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.156540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.156634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.158448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.158448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.158448] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.158448] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-507d1b0c-d574-4980-9713-8858c00943ae taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.158448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.158448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.158448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.158448] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('507d1b0c-d574-4980-9713-8858c00943ae',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.384657] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.384925] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.385077] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.385408] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.385598] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.385785] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port d82a3d32-d47f-4b52-8f0a-775eaf1cf481 not found, creating... [ 1217.387032] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.387032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.387032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.387032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.387032] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.387032] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.387326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.387326] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.387551] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.387617] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.387757] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: d82a3d32-d47f-4b52-8f0a-775eaf1cf481 is going to be created. [ 1217.410411] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.410793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.410793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.412707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.412707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.412707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.484147] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1217.484393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.561064] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.659999] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.661121] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.661366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.661366] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 507d1b0c-d574-4980-9713-8858c00943ae with status ACTIVE [ 1217.661587] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.661691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.661691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.661918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.662011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.662193] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.662290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.662351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.662502] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.662577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.662784] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.662881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.662941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.663878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.663976] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.664129] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 507d1b0c-d574-4980-9713-8858c00943ae is going to be updated. [ 1217.684266] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.684432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.684471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.684673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.684806] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.684966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.064942] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.065132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.065207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.065447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.065584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.065672] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1218.107151] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.107384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.107384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.108847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.108847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.118039] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1218.144160] env[65630]: INFO networking_nsxv3.common.synchronization [req-814a0c43-9ea2-4d40-a3a1-9cddd500a329 req-82fe6faf-1275-4579-a48c-97e78add9dcd service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1218.144553] env[65630]: INFO networking_nsxv3.common.synchronization [req-814a0c43-9ea2-4d40-a3a1-9cddd500a329 req-82fe6faf-1275-4579-a48c-97e78add9dcd service nova] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1218.144898] env[65630]: INFO networking_nsxv3.common.synchronization [req-814a0c43-9ea2-4d40-a3a1-9cddd500a329 req-82fe6faf-1275-4579-a48c-97e78add9dcd service nova] Enqueued Resource ID: d82a3d32-d47f-4b52-8f0a-775eaf1cf481 with Priority: HIGHEST for action port [ 1218.145710] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_rules [ 1218.145984] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1218.146241] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82a3d32-d47f-4b52-8f0a-775eaf1cf481 with Priority: HIGHEST for action port [ 1218.146719] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.147074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.147317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.147703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.147918] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.149142] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.149379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.149776] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.149958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.150659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.150659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.150659] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82a3d32-d47f-4b52-8f0a-775eaf1cf481',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.166203] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.653265] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.653620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.653620] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d82a3d32-d47f-4b52-8f0a-775eaf1cf481 with status ACTIVE [ 1218.653754] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.653975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.653975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.654227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.654348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.654551] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.654695] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.654781] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.655013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.655132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.655758] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.655758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.655758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.655758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.655967] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.655967] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d82a3d32-d47f-4b52-8f0a-775eaf1cf481 is going to be updated. [ 1218.672677] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.672677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.672677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.672677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.672677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.672963] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1218.679628] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.679892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.679956] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.680173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.680310] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.680488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d82a3d32-d47f-4b52-8f0a-775eaf1cf481" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.706123] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.706123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.706123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.706350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.706350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.716904] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1218.935888] env[65630]: INFO networking_nsxv3.common.synchronization [req-deb113d9-e652-4175-b7ca-f694c1bbd42e req-57d39f63-b834-47e2-8790-4057d585e8c9 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1218.936465] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1218.936797] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.936922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.936995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.941970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.942174] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.942317] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.942377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.942547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.942633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.942740] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.305959] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.305959] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.305959] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.306227] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.306445] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.306668] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.306831] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.307142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.307349] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.308538] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.308538] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.308538] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.308538] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.308538] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.308850] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.308850] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.332344] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.332605] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.332806] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.333009] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-935" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.333361] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-cbb6be39-59af-44bf-8a70-192f33597323 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.333643] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.333870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.334345] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.334671] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbb6be39-59af-44bf-8a70-192f33597323',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.449576] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.449784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.449857] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.450067] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.450163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.450378] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.450481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.450571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.450724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.450796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.450898] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1219.489239] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.489430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.490983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.490983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.490983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.503511] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1219.839874] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.840229] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.840313] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.840580] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.840736] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.840901] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port cbb6be39-59af-44bf-8a70-192f33597323 not found, creating... [ 1219.841185] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.841423] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.841565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.841957] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.842211] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.842515] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.842703] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.842793] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.843034] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.843166] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.843307] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: cbb6be39-59af-44bf-8a70-192f33597323 is going to be created. [ 1219.870256] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.870439] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.870590] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.870889] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.871139] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.871436] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.132371] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1220.132539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.132698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.132883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.134719] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.134719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.134719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.134719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.134719] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.134719] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.581108] env[65630]: INFO networking_nsxv3.common.synchronization [req-deb113d9-e652-4175-b7ca-f694c1bbd42e req-b8935068-034b-4338-a068-2ef96a4b74a0 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1220.581334] env[65630]: INFO networking_nsxv3.common.synchronization [req-deb113d9-e652-4175-b7ca-f694c1bbd42e req-b8935068-034b-4338-a068-2ef96a4b74a0 service nova] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1220.581421] env[65630]: INFO networking_nsxv3.common.synchronization [req-deb113d9-e652-4175-b7ca-f694c1bbd42e req-b8935068-034b-4338-a068-2ef96a4b74a0 service nova] Enqueued Resource ID: cbb6be39-59af-44bf-8a70-192f33597323 with Priority: HIGHEST for action port [ 1220.582030] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_rules [ 1220.582193] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1220.582310] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb6be39-59af-44bf-8a70-192f33597323 with Priority: HIGHEST for action port [ 1220.582621] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.582709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.582790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.582983] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.583975] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.584851] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.584939] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.585153] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbb6be39-59af-44bf-8a70-192f33597323 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.585255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.585322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.588323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.588496] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbb6be39-59af-44bf-8a70-192f33597323',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.636755] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.728211] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1220.728557] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.729322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.729733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.730227] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.730413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.730513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.730797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.730938] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.731100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.731629] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.960133] env[65630]: INFO networking_nsxv3.common.synchronization [req-71e6dc4b-9965-43a3-83f2-bf8a42e719e3 req-5f3d5d0b-a56d-456d-9cff-3feb86e5d0b2 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_members [ 1220.960751] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb with Priority: HIGHEST for action security_group_members [ 1220.961296] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f6b8a5b-bd24-49ea-96d6-51163d266deb taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.961480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.961553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.961796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.961978] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.962131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.962225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.962337] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.962426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.962530] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f6b8a5b-bd24-49ea-96d6-51163d266deb',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.091384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.091516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.091946] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbb6be39-59af-44bf-8a70-192f33597323 with status ACTIVE [ 1221.092371] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.092728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.092814] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.093032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.093129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.093311] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.093449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.094817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.094817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.094817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.094817] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.094817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.094817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.094817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.094817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.094817] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbb6be39-59af-44bf-8a70-192f33597323 is going to be updated. [ 1221.119764] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.119904] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.119962] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.122495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.122495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.122495] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbb6be39-59af-44bf-8a70-192f33597323" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.140457] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.235104] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.235325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.235381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.235746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.236045] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.236212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.236366] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.236494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.236657] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.236739] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.236897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.236995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.237088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.237224] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.237365] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.237459] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.237519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.237654] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.237741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.237844] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.237935] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.464806] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.465445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.465445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.465680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.465680] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.465948] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.466098] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.466186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.466391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.466501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.466625] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb is going to be updated. [ 1221.495945] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.495945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.496139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.496862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.496862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.511200] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb in Status: IN_PROGRESS for 2s [ 1221.513509] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1221.513736] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 deletion is rescheduled due to dependency. [ 1221.513887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.514088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.514561] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.515353] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.515353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.515353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.515353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.515353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.515353] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.642816] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.642954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.642954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.643209] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.643298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.643401] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1221.677158] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.677158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.677364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.677600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.677600] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.691641] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1221.744140] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1: rpc.has_security_group_logging(os_id): False [ 1221.766539] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.766539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.766539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.766886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.766886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.767129] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.767221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.767221] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.767379] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.767457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.767645] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.767742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.767799] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.767940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.768027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.768228] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.768326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.768389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.768529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.768604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.768688] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1221.834196] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.834352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.834423] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.834638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.834784] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.849666] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1222.020453] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.522565] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.025952] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.025952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.025952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.026380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.026380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.026380] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1223.058905] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.059010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.059010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.059229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.059390] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.070024] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1223.520947] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb in Status: SUCCESS [ 1223.521238] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f6b8a5b-bd24-49ea-96d6-51163d266deb deletion is rescheduled due to dependency. [ 1223.521383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f6b8a5b-bd24-49ea-96d6-51163d266deb" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.703513] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1223.703726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.703899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.704134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.704328] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.704445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.704505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.704653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.704734] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.704853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.704952] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.865591] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1223.865893] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.207541] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.207813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.207813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.208121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.208346] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.208492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.208579] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.208786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.208901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.209044] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.209220] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.209343] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.209421] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.209590] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.209817] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.209934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.210051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.210229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.210307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.210420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.210717] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.712856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d84857eb-b557-4aa2-8d62-34137b9cab1f: rpc.has_security_group_logging(os_id): False [ 1224.732566] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.732878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.732878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.733017] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.733114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.733335] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.733428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.733487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.733819] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.733995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.734329] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.734485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.734587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.734851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.734945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.735240] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.735387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.735484] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.735790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.735921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.736044] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1224.808311] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.808585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.808585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.808742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.808890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.826044] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1225.082565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1225.082565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.082565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.082786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.082923] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.083055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.083117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.083286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.083368] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.083453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.083544] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.585894] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.586255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.586255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.586382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.587053] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.587192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.587255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.587424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.587514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.587609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.587773] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.588062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.588062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.588369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.588521] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.588617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.588679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.588827] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.588908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.588993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.589255] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.962586] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.962769] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1226.091417] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ed098d0-aa55-4a88-be4f-3fe063ee74f6: rpc.has_security_group_logging(os_id): False [ 1226.112635] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.112796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.112894] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.113172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.113242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.113500] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.113643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.113711] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.113876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.113972] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.114270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.114353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.114353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.114493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.114559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.114759] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.114855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.114914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.115179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.115179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.115267] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1226.190647] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.190840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.190886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.191121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.191274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.210162] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1226.849520] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1226.849887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.229227] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1228.229526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.240682] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.240882] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.241015] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.241292] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.241571] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.241743] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.241868] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.242107] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.242257] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.242466] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.242577] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.242686] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.242792] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.242924] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.243050] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.243375] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.264780] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.265032] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1228.265165] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.265603] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-226" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.265739] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-0a6c2437-dd8c-488e-ac04-f26243492e29 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.265937] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.266072] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.266338] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.266474] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6c2437-dd8c-488e-ac04-f26243492e29',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.768812] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.769062] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.769188] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.769502] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.769758] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.770074] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.770237] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.770354] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.770577] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.770718] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.771180] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.771180] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.771314] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.771480] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.771613] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.771753] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 is going to be updated. [ 1228.793444] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.793678] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.793866] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.794226] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.794494] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.794796] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.517346] env[65630]: INFO networking_nsxv3.common.synchronization [req-32b1732f-371e-4302-b973-d205c8f36d5f req-0e911dc1-9faf-4fa5-a672-bd7c19e60346 service nova] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1229.517612] env[65630]: INFO networking_nsxv3.common.synchronization [req-32b1732f-371e-4302-b973-d205c8f36d5f req-0e911dc1-9faf-4fa5-a672-bd7c19e60346 service nova] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1229.517661] env[65630]: INFO networking_nsxv3.common.synchronization [req-32b1732f-371e-4302-b973-d205c8f36d5f req-0e911dc1-9faf-4fa5-a672-bd7c19e60346 service nova] Enqueued Resource ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 with Priority: HIGHEST for action port [ 1229.518396] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_rules [ 1229.518519] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1229.518620] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 with Priority: HIGHEST for action port [ 1229.518925] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.519079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.519134] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.519323] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.519761] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.520441] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.520441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.520441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.520651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.520708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.520982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.520982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.520982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.521107] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.521172] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.521988] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a6c2437-dd8c-488e-ac04-f26243492e29 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.522047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.522078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.522219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.522289] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6c2437-dd8c-488e-ac04-f26243492e29',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.024111] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.024411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.024514] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.025538] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a6c2437-dd8c-488e-ac04-f26243492e29 with status ACTIVE [ 1230.026184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.026184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.026184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.026184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.026434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.026555] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.028035] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.028035] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.028035] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a6c2437-dd8c-488e-ac04-f26243492e29 is going to be updated. [ 1230.051417] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.051627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.051690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.052284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.052284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.052284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a6c2437-dd8c-488e-ac04-f26243492e29" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.490240] env[65630]: INFO networking_nsxv3.common.synchronization [req-5ad89f43-ef9c-4875-baa3-8b960483f0d1 req-67d252f6-c4ca-4e34-845f-28c818051d92 tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1230.491156] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1230.491583] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.491757] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.491865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.492176] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.492393] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.492634] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.492714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.492906] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.493009] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.493112] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.530218] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.995344] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.033120] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.033338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.033338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.033988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.033988] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.033988] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b is going to be updated. [ 1231.069358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.069630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.069630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.069733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.069884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.081304] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: IN_PROGRESS for 2s [ 1231.498191] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.001204] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.001610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.001610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.001742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.002099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.002099] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1232.035259] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.035259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.035259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.035259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.035259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.045377] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1232.834918] env[65630]: INFO networking_nsxv3.common.synchronization [req-2b15018c-5c6a-4017-87b1-cc04a2484bb9 req-f863ce4b-39e5-44c6-bb63-ca67a8b93e61 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_members [ 1232.835428] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGHEST for action security_group_members [ 1232.835783] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.835901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.835989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.836186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.836341] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.836432] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.836494] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.836631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.836727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.836826] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.092754] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: SUCCESS [ 1233.093045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.093170] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.093348] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.093537] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.093664] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.093798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.093990] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.094085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.094174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.094296] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.339172] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.339370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.339457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.340222] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.340361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.340612] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.340731] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.340813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.341015] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.341120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.341230] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 is going to be updated. [ 1233.377997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.378201] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.378277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.378505] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.381121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.391968] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 in Status: IN_PROGRESS for 2s [ 1233.596920] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.759824] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.760050] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.760521] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.760521] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.760708] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.760805] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.760948] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.761178] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.761346] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.761577] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.761731] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.761856] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.761964] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.762134] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.762208] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.762339] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.784651] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.784923] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1233.785147] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.785548] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-371" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.786089] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-507d1b0c-d574-4980-9713-8858c00943ae taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.786332] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.786401] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.786698] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.786844] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('507d1b0c-d574-4980-9713-8858c00943ae',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.056397] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1234.056635] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.099793] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0f42bcf-1192-403d-b71c-67a606089c6b: rpc.has_security_group_logging(os_id): False [ 1234.118935] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.119166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.119215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.119409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.119501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.119791] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.119903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.119974] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.120211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.120315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.120429] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b is going to be updated. [ 1234.180422] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.180649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.180649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.180835] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.181046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.196497] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: IN_PROGRESS for 2s [ 1234.290085] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.290390] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.290495] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.290776] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.290932] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.291251] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.291411] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.291527] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.291754] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.291892] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.292220] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.292345] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.292456] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.292666] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.292798] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.292944] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 507d1b0c-d574-4980-9713-8858c00943ae is going to be updated. [ 1234.324729] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.325142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.325142] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.325355] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.325558] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.325862] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.034498] env[65630]: INFO networking_nsxv3.common.synchronization [req-bd947dea-ff22-4127-8a28-4390fce51214 req-7a6f7345-b35b-4954-8dd8-514896b56cbb service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1235.034498] env[65630]: INFO networking_nsxv3.common.synchronization [req-bd947dea-ff22-4127-8a28-4390fce51214 req-7a6f7345-b35b-4954-8dd8-514896b56cbb service nova] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1235.034498] env[65630]: INFO networking_nsxv3.common.synchronization [req-bd947dea-ff22-4127-8a28-4390fce51214 req-7a6f7345-b35b-4954-8dd8-514896b56cbb service nova] Enqueued Resource ID: 507d1b0c-d574-4980-9713-8858c00943ae with Priority: HIGHEST for action port [ 1235.035254] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_rules [ 1235.035462] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1235.035502] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 507d1b0c-d574-4980-9713-8858c00943ae with Priority: HIGHEST for action port [ 1235.035927] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.036078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.036147] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.036361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.036443] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.037870] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.037870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.037870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.037870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.038139] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.038139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.038139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.039030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.039030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.039030] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.039628] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-507d1b0c-d574-4980-9713-8858c00943ae taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.039628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.039724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.040197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.040197] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('507d1b0c-d574-4980-9713-8858c00943ae',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.406454] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 in Status: SUCCESS [ 1235.407034] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 deletion is rescheduled due to dependency. [ 1235.407034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.541892] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.542283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.542421] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.543697] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 507d1b0c-d574-4980-9713-8858c00943ae with status ACTIVE [ 1235.544019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.544479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.544479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.544740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.544740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.544963] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.545897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.545897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.545897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.545897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.545897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.546215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.546215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.546215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.546336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.546376] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 507d1b0c-d574-4980-9713-8858c00943ae is going to be updated. [ 1235.575380] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.575581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.575581] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.575845] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.576016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.576260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-507d1b0c-d574-4980-9713-8858c00943ae" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.049027] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.213299] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: SUCCESS [ 1236.213299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.551433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.551840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.551840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.551840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.552023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.552023] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1236.594971] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.595252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.595252] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.595391] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.595542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.609163] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1238.624327] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1238.624746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.624746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.624996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.625293] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.625420] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.625489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.625662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.625744] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.625900] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.626039] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.128620] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.128620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.128620] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.128964] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.129168] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.129332] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.129536] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.129966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.130136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.130239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.130467] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.130522] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.130640] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.130828] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.131090] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.131090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.131197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.131314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.131410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.132000] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.132000] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.563349] env[65630]: INFO networking_nsxv3.common.synchronization [None req-d3069497-22cf-4603-8134-c39e528e9080 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_rules [ 1239.564884] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_rules [ 1239.567482] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-412ff777-134b-424f-a605-d1ecbc661b35 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.567694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.568016] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.568377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.568504] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.635265] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1: rpc.has_security_group_logging(os_id): False [ 1239.661457] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.661457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.661457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.661457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.661457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.661813] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.661813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.661813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.661970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.661970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.662177] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.662277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.662333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.662477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.662551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.662750] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.662880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.663394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.663394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.663394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.663394] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1239.665622] env[65630]: INFO networking_nsxv3.common.synchronization [None req-845d93d3-96f1-487e-a481-75e894efe74f tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_rules [ 1239.666008] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_rules [ 1239.666701] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-412ff777-134b-424f-a605-d1ecbc661b35 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.666821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.741926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.742193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.742193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.742363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.742969] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.763932] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1240.093580] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.093803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.093863] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.094251] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.094485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.094719] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 412ff777-134b-424f-a605-d1ecbc661b35 already deleted. [ 1240.094950] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.095283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.095623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.095991] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.630927] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.631101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.631174] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.631388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.631556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.631589] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 412ff777-134b-424f-a605-d1ecbc661b35 already deleted. [ 1240.631773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.226158] env[65630]: INFO networking_nsxv3.common.synchronization [req-d2ffde98-b387-4f21-addb-eba3746166d5 req-62852b43-07d5-4c37-8419-4f0442544f59 tempest-ImagesTestJSON-878873352 tempest-ImagesTestJSON-878873352-project-member] Enqueued Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1241.226545] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 with Priority: HIGHEST for action security_group_members [ 1241.226915] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.226915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.227038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.227714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.227714] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.227714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.227714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.227714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.227714] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.227999] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ed098d0-aa55-4a88-be4f-3fe063ee74f6',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.480566] env[65630]: INFO networking_nsxv3.common.synchronization [req-61e81dfe-bd20-40fa-9c2a-9fe92e15acd1 req-ea0ecbe2-34ab-4180-a48b-d692b7ee9deb tempest-DeleteServersTestJSON-133207581 tempest-DeleteServersTestJSON-133207581-project-member] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1241.481116] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGHEST for action security_group_members [ 1241.481427] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.481549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.481615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.481808] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.482012] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.482139] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.482205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.482363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.482450] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.482542] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.730509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.730675] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.730746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.730978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.731088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.731288] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.731387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.731448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.731597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.731672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.731758] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 is going to be updated. [ 1241.758509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.758684] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.758729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.758928] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.759086] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.769974] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: IN_PROGRESS for 2s [ 1241.779793] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1241.780022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.984997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.985241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.985241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.985463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.985553] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.985763] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.985951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.986033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.986163] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.986254] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.986384] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be updated. [ 1242.015364] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.015565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.015565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.015779] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.015960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.025754] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: IN_PROGRESS for 2s [ 1243.088255] env[65630]: INFO networking_nsxv3.common.synchronization [req-c1532a88-4016-4818-ae30-20d7f0517cc6 req-70001627-3783-40b2-8f84-13558afb736f tempest-ServersTestJSON-987399763 tempest-ServersTestJSON-987399763-project-member] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1243.089258] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGHEST for action security_group_members [ 1243.089606] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.089722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.089785] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.090014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.090197] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.090299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.090363] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.090516] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.090601] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.090691] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.593473] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.594262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.594399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.594583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.594678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.594890] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.595014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.595079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.595246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.595350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.595444] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be updated. [ 1243.628912] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.629070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.629070] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.629232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.629353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.639220] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: IN_PROGRESS for 2s [ 1243.780506] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 in Status: SUCCESS [ 1243.780723] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ed098d0-aa55-4a88-be4f-3fe063ee74f6 deletion is rescheduled due to dependency. [ 1243.780790] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ed098d0-aa55-4a88-be4f-3fe063ee74f6" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.035912] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 in Status: SUCCESS [ 1244.036139] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 deletion is rescheduled due to dependency. [ 1244.036299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.388744] env[65630]: INFO networking_nsxv3.common.synchronization [req-06f957db-5a52-4c7c-8257-b3bfd04556fa req-6d07e3c7-2cb1-42ce-b76c-dabcfe2cc5d5 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_members [ 1245.389312] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_members [ 1245.389659] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-412ff777-134b-424f-a605-d1ecbc661b35 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.389798] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.390583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.390583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.390583] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.390583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.390583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.390583] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.390913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.390913] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.651949] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d84857eb-b557-4aa2-8d62-34137b9cab1f in Status: SUCCESS [ 1245.652147] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f deletion is rescheduled due to dependency. [ 1245.652263] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.664952] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.665168] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.665293] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.665562] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.665819] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.666125] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.666276] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.666503] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.666650] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.666897] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.666977] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1245.667096] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1245.667202] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1245.667312] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1245.667415] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1245.667545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1245.688111] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1245.688301] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1245.688395] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1245.688571] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.688883] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-3cc11648-a79c-4318-a157-8f16bc1cc96d taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.689070] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.689192] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.689522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.689657] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc11648-a79c-4318-a157-8f16bc1cc96d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.894104] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.894104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.894104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.894104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.894104] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.894435] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.894435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.894435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.894629] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.894750] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.894859] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 412ff777-134b-424f-a605-d1ecbc661b35 already deleted. [ 1245.894947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.192057] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.192261] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.192458] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.192679] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.192826] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.192982] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Segment Port 3cc11648-a79c-4318-a157-8f16bc1cc96d not found, creating... [ 1246.193258] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.193416] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.193530] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.193750] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.193912] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.194216] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.194417] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.194565] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.194778] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.194910] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.195065] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: 3cc11648-a79c-4318-a157-8f16bc1cc96d is going to be created. [ 1246.217748] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.217997] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.218096] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.218413] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.218667] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.218902] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.808610] env[65630]: INFO networking_nsxv3.common.synchronization [req-6b86a87b-cf80-4c2c-8af2-a6bd9543c94f req-db25601f-ceac-4f08-83b9-663bb8a69d96 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_members [ 1246.809221] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGHEST for action security_group_members [ 1246.809536] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.809679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.809726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.810585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.810585] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.810585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.810585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.810585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.810585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.810585] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.945397] env[65630]: INFO networking_nsxv3.common.synchronization [req-06f957db-5a52-4c7c-8257-b3bfd04556fa req-b5d35734-89fa-4ab3-ac22-a89bf87f367e service nova] Enqueued Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_rules [ 1246.945397] env[65630]: INFO networking_nsxv3.common.synchronization [req-06f957db-5a52-4c7c-8257-b3bfd04556fa req-b5d35734-89fa-4ab3-ac22-a89bf87f367e service nova] Enqueued Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_members [ 1246.946831] env[65630]: INFO networking_nsxv3.common.synchronization [req-06f957db-5a52-4c7c-8257-b3bfd04556fa req-b5d35734-89fa-4ab3-ac22-a89bf87f367e service nova] Enqueued Resource ID: 3cc11648-a79c-4318-a157-8f16bc1cc96d with Priority: HIGHEST for action port [ 1246.948207] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_rules [ 1246.948385] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_members [ 1246.948469] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc11648-a79c-4318-a157-8f16bc1cc96d with Priority: HIGHEST for action port [ 1246.949130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-412ff777-134b-424f-a605-d1ecbc661b35 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.949130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.949130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.949248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.949248] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.950319] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-412ff777-134b-424f-a605-d1ecbc661b35 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.950319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.950429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.950577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.950708] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.950876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.950876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.952642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.952642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.952642] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.952642] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cc11648-a79c-4318-a157-8f16bc1cc96d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.952642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.953204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.953204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.953204] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc11648-a79c-4318-a157-8f16bc1cc96d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.313358] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.313585] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.313633] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.313890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.313996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.314222] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.314376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.314376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.314535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.314613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.314702] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 is going to be updated. [ 1247.344712] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.344946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.344946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.345154] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.345296] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.355428] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 in Status: IN_PROGRESS for 2s [ 1247.456391] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-412ff777-134b-424f-a605-d1ecbc661b35 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.456558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.456720] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.457856] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cc11648-a79c-4318-a157-8f16bc1cc96d with status ACTIVE [ 1247.458088] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.458244] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.458318] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.458535] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.458626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.458802] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.458903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.458985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.459183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.459264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.459449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.459545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.459607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.459747] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.459927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.459927] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cc11648-a79c-4318-a157-8f16bc1cc96d is going to be updated. [ 1247.485549] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.485703] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.485777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.486048] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.486200] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.486365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cc11648-a79c-4318-a157-8f16bc1cc96d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.961723] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.464430] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.464688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.464688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.464880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.464975] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.465129] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 412ff777-134b-424f-a605-d1ecbc661b35 is going to be created. [ 1248.491763] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.491913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.492008] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.492215] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.492369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.506478] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 412ff777-134b-424f-a605-d1ecbc661b35 in Status: UNINITIALIZED for 2s [ 1249.368512] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 in Status: SUCCESS [ 1249.368867] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 deletion is rescheduled due to dependency. [ 1249.369101] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.517634] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 412ff777-134b-424f-a605-d1ecbc661b35 in Status: SUCCESS [ 1250.517905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.517996] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.518236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.518436] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.518554] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.518641] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.518772] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.518851] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.518934] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.519033] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.021681] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.123857] env[65630]: INFO networking_nsxv3.common.synchronization [req-3833e284-cbfe-40cd-b9df-dfe90eeb3ea7 req-a662d3d8-96e9-4e19-b0a4-e6d738d9ee0f tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1251.124580] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1251.125474] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.125639] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.125713] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.125977] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.126236] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.126349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.126426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.126615] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.126707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.127544] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.524988] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 412ff777-134b-424f-a605-d1ecbc661b35: rpc.has_security_group_logging(os_id): False [ 1251.544334] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.545876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.548289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.548289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.548289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.548289] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.548289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.548289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.548289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.548289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.548289] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 412ff777-134b-424f-a605-d1ecbc661b35 is going to be created. [ 1251.614660] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.614660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.614660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.614660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.614660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.624168] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 412ff777-134b-424f-a605-d1ecbc661b35 in Status: IN_PROGRESS for 2s [ 1251.630285] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.131581] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.633811] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.634149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.634149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.634236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.634285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.634409] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be updated. [ 1252.667945] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.668138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.668194] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.668397] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.668541] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.679302] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: IN_PROGRESS for 2s [ 1253.638719] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 412ff777-134b-424f-a605-d1ecbc661b35 in Status: SUCCESS [ 1253.638986] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.689730] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: SUCCESS [ 1254.690184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.262199] env[65630]: INFO networking_nsxv3.common.synchronization [None req-69a2124f-ec2d-4d10-8447-9e6d3ba974f0 None None] Enqueued Resource ID: 39b42fe8-492b-4697-af0f-cd874af02708 with Priority: HIGHEST for action port [ 1255.262788] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b42fe8-492b-4697-af0f-cd874af02708 with Priority: HIGHEST for action port [ 1255.263196] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-39b42fe8-492b-4697-af0f-cd874af02708 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.263320] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39b42fe8-492b-4697-af0f-cd874af02708" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.263563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39b42fe8-492b-4697-af0f-cd874af02708" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.263652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39b42fe8-492b-4697-af0f-cd874af02708" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.263790] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b42fe8-492b-4697-af0f-cd874af02708',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.766720] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39b42fe8-492b-4697-af0f-cd874af02708 [ 1255.766985] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.767125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.767195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.767399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.767487] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.767584] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39b42fe8-492b-4697-af0f-cd874af02708 already deleted. [ 1255.767668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39b42fe8-492b-4697-af0f-cd874af02708" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.640062] env[65630]: INFO networking_nsxv3.common.synchronization [None req-e629e371-ac06-4d76-896c-74643be015f1 None None] Enqueued Resource ID: 5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a with Priority: HIGHEST for action port [ 1257.641035] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a with Priority: HIGHEST for action port [ 1257.641367] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.641593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.641593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.641804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.641960] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.143814] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a [ 1258.144051] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.144195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.144262] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.144467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.144549] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.144651] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a already deleted. [ 1258.144736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ac9f504-6fc9-46d6-a0e3-1ad05c884f6a" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.613078] env[65630]: INFO networking_nsxv3.common.synchronization [req-755dcff1-fe8b-4828-a730-3875bf2a1b9e req-62085520-f266-4ea3-a940-5b4f3b08f81b tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1259.613694] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGHEST for action security_group_members [ 1259.614109] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.614276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.614359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.614625] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.614838] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.614959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.615030] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.615203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.615303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.615432] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.725166] env[65630]: INFO networking_nsxv3.common.synchronization [req-a28f8773-183e-4a73-b5c0-77ff050199e5 req-0b218a70-f47b-4496-a03e-35656febca17 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1259.726026] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1259.726370] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.726488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.726564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.726764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.726919] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.727028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.727094] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.727245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.727353] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.727439] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.059741] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.059954] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.060105] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.060385] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.060670] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.060838] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.060967] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.061455] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.061623] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.061845] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.061975] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1260.062107] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1260.062271] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1260.062451] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.062581] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1260.062729] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.083045] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.083223] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1260.083360] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.083533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.083847] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.084075] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.084174] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.084612] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.084761] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842d71c7-dca1-43fb-8e60-a5fd7f6cc626',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.117571] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.117745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.117793] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.117979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.118088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.118283] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.118401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.118471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.118623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.118700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.118786] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be updated. [ 1260.149602] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.149775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.149842] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.150142] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.150359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.160735] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: IN_PROGRESS for 2s [ 1260.229495] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.229666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.229848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.230045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.230155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.230347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.230448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.230504] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.230673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.230777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.230869] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be deleted. [ 1260.266442] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.266646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.266646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.266866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.266963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.267088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.587271] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.587522] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.587657] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.587955] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.588132] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.588293] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 not found, creating... [ 1260.588790] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.588974] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.589117] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.589362] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.589501] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.589804] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.589961] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.590090] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.590308] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.590444] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.590582] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 is going to be created. [ 1260.611774] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.612165] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.612165] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.612362] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.612582] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.612803] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.347250] env[65630]: INFO networking_nsxv3.common.synchronization [req-a28f8773-183e-4a73-b5c0-77ff050199e5 req-f3b1020a-251a-4179-b189-35dd2bc9c766 service nova] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_rules [ 1261.347563] env[65630]: INFO networking_nsxv3.common.synchronization [req-a28f8773-183e-4a73-b5c0-77ff050199e5 req-f3b1020a-251a-4179-b189-35dd2bc9c766 service nova] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1261.347712] env[65630]: INFO networking_nsxv3.common.synchronization [req-a28f8773-183e-4a73-b5c0-77ff050199e5 req-f3b1020a-251a-4179-b189-35dd2bc9c766 service nova] Enqueued Resource ID: 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 with Priority: HIGHEST for action port [ 1261.348131] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_rules [ 1261.348264] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1261.348364] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 with Priority: HIGHEST for action port [ 1261.348646] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.348767] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.348823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.349038] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.349122] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.350352] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.350474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.350574] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.350746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.350911] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.351388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.351388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.351388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.351388] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.351525] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.353850] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.353850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.353850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.353850] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.353850] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842d71c7-dca1-43fb-8e60-a5fd7f6cc626',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.855519] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.855519] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.855519] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.855782] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 with status ACTIVE [ 1261.856400] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.856400] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.856618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.856946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.857188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.857424] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.857479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.857515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.857738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.857829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.858049] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.858169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.858444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.858444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.858701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.858701] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 is going to be updated. [ 1261.880979] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.880979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.880979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.880979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.880979] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.881356] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.170832] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 in Status: SUCCESS [ 1262.171015] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 deletion is rescheduled due to dependency. [ 1262.171141] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.356159] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.858450] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.858604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.858646] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.859463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.859463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.859463] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be created. [ 1262.881408] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.881544] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.881618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.881829] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.881989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.893350] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: UNINITIALIZED for 2s [ 1262.967449] env[65630]: INFO networking_nsxv3.common.synchronization [req-45b6bb85-2f19-406e-9cd0-9f607add07c1 req-5bbb1fa8-2b3c-4d18-a6a1-8157f8827aa8 tempest-ServerGroupTestJSON-1459963128 tempest-ServerGroupTestJSON-1459963128-project-member] Enqueued Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_members [ 1262.968035] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_members [ 1262.968404] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.968508] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.968572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.969047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.969047] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.969047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.969394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.969394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.969394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.969537] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.351335] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.351532] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-65" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.352237] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-65" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.352237] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-65" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.352401] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.352504] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.352636] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.352863] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.353030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.353276] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.353449] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.353603] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.353742] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.353870] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.353976] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.354127] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.378166] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.378488] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1263.378488] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.378597] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-65" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.378853] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.379184] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.379184] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.379519] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.379742] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c42f79f1-1ca0-45e7-8647-f22b7fc720e0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.471448] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.471653] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.471724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.471919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.472018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.472209] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.472305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.472359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.472515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.472591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.472672] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 already deleted. [ 1263.472755] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.882223] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.882379] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.882509] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.882789] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.883048] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.883241] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port c42f79f1-1ca0-45e7-8647-f22b7fc720e0 not found, creating... [ 1263.883542] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.883735] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.883852] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.884120] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.884270] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.884554] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.884708] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.884824] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.885046] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.885182] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.885338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: c42f79f1-1ca0-45e7-8647-f22b7fc720e0 is going to be created. [ 1263.906801] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.906801] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.906801] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.907038] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.907707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.907707] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.171471] env[65630]: INFO networking_nsxv3.common.synchronization [None req-674c6cce-eb0b-478c-b052-4d277a3f22f9 tempest-AttachInterfacesTestJSON-2005993567 tempest-AttachInterfacesTestJSON-2005993567-project-member] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1264.172083] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGHEST for action security_group_members [ 1264.172997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.173145] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.173216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.173467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.173653] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.173760] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.173838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.174028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.174111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.174203] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.626091] env[65630]: INFO networking_nsxv3.common.synchronization [req-45b6bb85-2f19-406e-9cd0-9f607add07c1 req-ea49cda4-b6c9-4672-aed1-4274a4284b43 service nova] Enqueued Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_rules [ 1264.626657] env[65630]: INFO networking_nsxv3.common.synchronization [req-45b6bb85-2f19-406e-9cd0-9f607add07c1 req-ea49cda4-b6c9-4672-aed1-4274a4284b43 service nova] Enqueued Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_members [ 1264.626806] env[65630]: INFO networking_nsxv3.common.synchronization [req-45b6bb85-2f19-406e-9cd0-9f607add07c1 req-ea49cda4-b6c9-4672-aed1-4274a4284b43 service nova] Enqueued Resource ID: c42f79f1-1ca0-45e7-8647-f22b7fc720e0 with Priority: HIGHEST for action port [ 1264.627397] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_rules [ 1264.627686] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_members [ 1264.627834] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42f79f1-1ca0-45e7-8647-f22b7fc720e0 with Priority: HIGHEST for action port [ 1264.628158] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.628306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.628422] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.628697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.628785] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.629691] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.629973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.629973] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.630264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.630264] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.630401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.630401] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.630537] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.630651] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.631104] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.632086] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.632197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.632258] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.632795] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.632795] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c42f79f1-1ca0-45e7-8647-f22b7fc720e0',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.677107] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.677289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.677351] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.677576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.677667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.677862] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.677991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.678071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.678232] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.678410] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.678410] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be updated. [ 1264.708075] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.708241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.708306] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.708604] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.708691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.719289] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: IN_PROGRESS for 2s [ 1264.902236] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: SUCCESS [ 1264.902526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.902699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.902997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.903244] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.903409] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.903485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.903678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.903796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.903943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.904127] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.134493] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.134725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.135072] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.136176] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c42f79f1-1ca0-45e7-8647-f22b7fc720e0 with status ACTIVE [ 1265.136472] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.136627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.136674] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.137011] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.137103] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.138267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.138375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.138448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.138627] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.138707] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.138913] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.139027] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.139076] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.139227] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.139304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.139392] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c42f79f1-1ca0-45e7-8647-f22b7fc720e0 is going to be updated. [ 1265.162404] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.162599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.162642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.162848] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.162980] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.163169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c42f79f1-1ca0-45e7-8647-f22b7fc720e0" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.408247] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.408514] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.408915] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.409240] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.409438] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.409548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.409610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.409775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.409866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.409951] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.410550] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.410774] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.410880] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.411131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.411313] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.411499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.411499] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.411662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.411761] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.411872] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.411970] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.641082] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.916705] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 201b4cc2-0baa-4c4b-b457-1bb173e25095: rpc.has_security_group_logging(os_id): False [ 1265.934912] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.935162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.935162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.935371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.935497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.935692] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.935807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.935859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.936036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.936137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.936383] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.936478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.936543] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.936691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.936766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.936947] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.937061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.937129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.937268] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.937352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.937417] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be created. [ 1266.018452] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.018669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.018669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.019329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.019329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.035079] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: IN_PROGRESS for 2s [ 1266.142922] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.143120] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.143188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.143380] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.143474] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.143565] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 is going to be created. [ 1266.173034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.173197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.173413] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.173511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.173658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.186455] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 in Status: UNINITIALIZED for 2s [ 1266.735743] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 in Status: SUCCESS [ 1266.736039] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 deletion is rescheduled due to dependency. [ 1266.736169] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.058431] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: SUCCESS [ 1268.058866] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.197210] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 in Status: SUCCESS [ 1268.197908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.198632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.199994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.199994] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.199994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.199994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.199994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.199994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.199994] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.199994] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.491495] env[65630]: INFO networking_nsxv3.common.synchronization [None req-19341d3d-6ca6-4112-af1d-36b5c8bb710b None None] Enqueued Resource ID: 2c389208-1cc7-476d-9222-2ea051764f94 with Priority: HIGHEST for action port [ 1268.492276] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c389208-1cc7-476d-9222-2ea051764f94 with Priority: HIGHEST for action port [ 1268.492474] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c389208-1cc7-476d-9222-2ea051764f94 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.492648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c389208-1cc7-476d-9222-2ea051764f94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.492648] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c389208-1cc7-476d-9222-2ea051764f94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.493078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c389208-1cc7-476d-9222-2ea051764f94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.493078] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c389208-1cc7-476d-9222-2ea051764f94',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.703286] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.703461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.703524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.703729] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.703913] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.704033] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.704111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.704287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.704381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.704472] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.704624] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.704720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.704782] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.704978] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.705162] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.705259] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.705349] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.705497] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.705555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.705623] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.705712] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.994900] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c389208-1cc7-476d-9222-2ea051764f94 [ 1268.995758] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.995758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.995758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.995758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.995758] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.995758] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c389208-1cc7-476d-9222-2ea051764f94 already deleted. [ 1268.996045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c389208-1cc7-476d-9222-2ea051764f94" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.208512] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce9a5258-fb15-458a-b6e3-3ed66efd5ab1: rpc.has_security_group_logging(os_id): False [ 1269.228074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.228282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.228282] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.228855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.228855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.228855] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.228855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.229023] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.229057] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.229133] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.229334] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.230034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.230034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.230034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.230034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.230034] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.230034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.230034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.230605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.230605] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.230605] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 is going to be created. [ 1269.302435] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.302773] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.303311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.303311] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.303479] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.315033] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 in Status: IN_PROGRESS for 2s [ 1269.357584] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1269.358443] env[65630]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5d364453-b283-467b-8307-5e17fe017293 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1271.078592] env[65630]: INFO networking_nsxv3.common.synchronization [None req-cc027c8b-16f6-4a0a-baf3-ebeea0706873 None None] Enqueued Resource ID: c55b3702-7408-48ed-b417-9f4f092380cd with Priority: HIGHEST for action port [ 1271.078995] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55b3702-7408-48ed-b417-9f4f092380cd with Priority: HIGHEST for action port [ 1271.079698] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-c55b3702-7408-48ed-b417-9f4f092380cd taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.079860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c55b3702-7408-48ed-b417-9f4f092380cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.079949] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c55b3702-7408-48ed-b417-9f4f092380cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.080315] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c55b3702-7408-48ed-b417-9f4f092380cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.080433] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55b3702-7408-48ed-b417-9f4f092380cd',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.329915] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 in Status: SUCCESS [ 1271.330173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.585287] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c55b3702-7408-48ed-b417-9f4f092380cd [ 1271.585287] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.585287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.585287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.585287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.585287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.585287] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c55b3702-7408-48ed-b417-9f4f092380cd already deleted. [ 1271.585287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c55b3702-7408-48ed-b417-9f4f092380cd" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.623111] env[65630]: INFO networking_nsxv3.common.synchronization [req-edafddd6-f677-4066-aeea-cc8e5781003a req-912d1f4d-e3a5-48bc-bf69-ee5762724896 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1271.623850] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGHEST for action security_group_members [ 1271.624684] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.624823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.624947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.625189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.625467] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.625467] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.625570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.625668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.625753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.625899] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.684390] env[65630]: INFO networking_nsxv3.common.synchronization [req-edafddd6-f677-4066-aeea-cc8e5781003a req-912d1f4d-e3a5-48bc-bf69-ee5762724896 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 with Priority: HIGHEST for action port [ 1271.684919] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 with Priority: HIGHEST for action port [ 1271.685433] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.685433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.685433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.685606] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.685681] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842d71c7-dca1-43fb-8e60-a5fd7f6cc626',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.130130] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.130437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.130437] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.130820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.130820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.130898] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.130985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.131059] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.131216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.131294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.131380] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be updated. [ 1272.161554] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.161751] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.161802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.161995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.162168] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.172356] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: IN_PROGRESS for 2s [ 1272.187905] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 with status ACTIVE [ 1272.188257] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.188453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.188547] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.188775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.188868] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.189057] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.189184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.189250] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.189408] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.189483] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.189662] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.189815] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.189884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.190045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.190122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.190222] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 842d71c7-dca1-43fb-8e60-a5fd7f6cc626 is going to be updated. [ 1272.213586] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.213764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.213833] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.214058] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.214404] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.214618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842d71c7-dca1-43fb-8e60-a5fd7f6cc626" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.184584] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 in Status: SUCCESS [ 1274.185072] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 deletion is rescheduled due to dependency. [ 1274.185072] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.288693] env[65630]: INFO networking_nsxv3.common.synchronization [req-b39130a5-a5cd-4049-aada-cb86ff1651cf req-5a158b08-c3ac-41a0-aef9-acfd1fd71728 tempest-InstanceActionsV221TestJSON-967487894 tempest-InstanceActionsV221TestJSON-967487894-project-member] Enqueued Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_members [ 1274.289436] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_members [ 1274.289634] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.289753] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.289834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.290100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.290267] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.290370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.290477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.290617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.290709] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.290814] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.600217] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-715 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.600435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-715" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.600560] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-715" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.600893] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-715" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.601169] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.601328] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.601642] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.601870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.602027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.602236] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.602349] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.602462] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.602568] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.602680] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.602785] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.603334] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.625395] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.625547] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.625673] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.625882] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-715" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.626277] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.626483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.626601] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.626975] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.627185] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cac1d8c-6364-4a4f-9aea-a80da3a01fa2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.793323] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.793528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.793577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.793775] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.793869] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.794092] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.794241] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.794309] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.794449] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.794528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.794614] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 already deleted. [ 1274.794691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.130266] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.130541] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.130687] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.131074] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.131273] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.131503] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 not found, creating... [ 1275.131692] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.131850] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.131966] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.132203] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.132463] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.132903] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.133090] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.133210] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.133435] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.133599] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.133763] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 is going to be created. [ 1275.154924] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.155163] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.155286] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.155561] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.155819] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.156066] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.888110] env[65630]: INFO networking_nsxv3.common.synchronization [req-b39130a5-a5cd-4049-aada-cb86ff1651cf req-7f562f1a-20a8-48a2-874f-8407525422d1 service nova] Enqueued Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_rules [ 1275.888437] env[65630]: INFO networking_nsxv3.common.synchronization [req-b39130a5-a5cd-4049-aada-cb86ff1651cf req-7f562f1a-20a8-48a2-874f-8407525422d1 service nova] Enqueued Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_members [ 1275.888437] env[65630]: INFO networking_nsxv3.common.synchronization [req-b39130a5-a5cd-4049-aada-cb86ff1651cf req-7f562f1a-20a8-48a2-874f-8407525422d1 service nova] Enqueued Resource ID: 2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 with Priority: HIGHEST for action port [ 1275.888996] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_rules [ 1275.889176] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_members [ 1275.889300] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 with Priority: HIGHEST for action port [ 1275.889626] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.889763] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.889823] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.890088] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.890168] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.891076] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.891195] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.891260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.892325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.892325] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.892325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.892325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.892325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.892325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.892325] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.893520] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.893520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.893520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.893520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.893520] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cac1d8c-6364-4a4f-9aea-a80da3a01fa2',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.395364] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.396524] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.396693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.396797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 with status ACTIVE [ 1276.396992] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.397119] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.397185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.397434] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.397527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.397702] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.397818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.397886] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.398046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.398127] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.398309] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.398431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.398539] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.398665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.398740] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.398824] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cac1d8c-6364-4a4f-9aea-a80da3a01fa2 is going to be updated. [ 1276.422783] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.422984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.422984] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.423190] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.423326] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.423485] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cac1d8c-6364-4a4f-9aea-a80da3a01fa2" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.901199] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.403567] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.403796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.403796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.403999] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.404118] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.404280] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 is going to be created. [ 1277.428262] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.428471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.428520] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.428858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.429075] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.439120] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 in Status: UNINITIALIZED for 2s [ 1278.411055] env[65630]: INFO networking_nsxv3.common.synchronization [req-3009162d-318e-4546-b4aa-21c2c1091ad7 req-368beb48-86fd-4423-8472-738d607f7819 tempest-ServerGroupTestJSON-1459963128 tempest-ServerGroupTestJSON-1459963128-project-member] Enqueued Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_members [ 1278.412741] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGHEST for action security_group_members [ 1278.412741] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.412741] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.413091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.413576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.413576] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.413576] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.413783] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.415444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.415444] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.415444] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.919399] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.919672] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.919796] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.920944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.920944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.920944] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.920944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.920944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.920944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.920944] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.920944] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 is going to be updated. [ 1278.954055] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.954213] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.954284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.954805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.954805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.965557] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 in Status: IN_PROGRESS for 2s [ 1279.450401] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 in Status: SUCCESS [ 1279.450787] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.450883] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.451136] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.451363] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.451715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.451715] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.451897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.451897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.452047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.452118] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.954882] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.955071] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.955140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.955389] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.955569] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.955679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.955746] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.955917] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.956022] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.956144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.956302] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.956415] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.956489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.956636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.956787] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.956961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.956961] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.957085] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.957166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.957247] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.957384] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.460223] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66073fc6-c410-4bfa-8cca-8f91f86be7d3: rpc.has_security_group_logging(os_id): False [ 1280.482986] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.483193] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.483239] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.483441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.483532] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.483753] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.483854] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.483918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.484100] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.484222] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.484371] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.484464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.484526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.484667] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.484742] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.485109] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.485272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.485342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.485492] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.485568] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.485755] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 is going to be created. [ 1280.565091] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.565365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.565365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.565531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.565762] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.576659] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 in Status: IN_PROGRESS for 2s [ 1280.975218] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 in Status: SUCCESS [ 1280.975419] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 deletion is rescheduled due to dependency. [ 1280.975587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.593333] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 in Status: SUCCESS [ 1282.593865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.401246] env[65630]: INFO networking_nsxv3.common.synchronization [req-d5c97679-6c4d-4421-b9b7-f61a52f61e91 req-68f6ea2a-dc81-498d-be24-a6b90b333eab tempest-AttachVolumeShelveTestJSON-1399021062 tempest-AttachVolumeShelveTestJSON-1399021062-project-member] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1283.401824] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGHEST for action security_group_members [ 1283.402307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.402307] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.402429] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.402528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.402719] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.402821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.402884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.403475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.403475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.403475] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.905366] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.905926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.905926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.905926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.905926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.906190] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.906274] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.906347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.906493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.906577] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.906664] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b is going to be updated. [ 1283.941485] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.941771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.941771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.941989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.942159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.951010] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: IN_PROGRESS for 2s [ 1285.963729] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0f42bcf-1192-403d-b71c-67a606089c6b in Status: SUCCESS [ 1285.964242] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b deletion is rescheduled due to dependency. [ 1285.964242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.089656] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock network-742 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.089853] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.089974] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.090257] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.090566] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.090735] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.090853] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.091082] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.091228] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.091462] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1286.091546] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1286.091652] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1286.091758] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1286.091864] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1286.091965] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1286.092124] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1286.111039] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1286.111039] env[65630]: DEBUG dogpile.cache.region [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1286.111039] env[65630]: DEBUG dogpile.lock [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1286.111237] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "network-742" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.111415] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock port-cc17cda7-fd03-4178-a8a2-f0215753c05f taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.111609] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.111741] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.112033] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.112247] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc17cda7-fd03-4178-a8a2-f0215753c05f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.614616] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.614835] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.614960] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.615276] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.615430] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.615726] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.615883] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.615998] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.616232] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.616421] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.616714] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.616870] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.616982] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.617205] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.617337] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.617485] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Resource: SegmentPort with ID: cc17cda7-fd03-4178-a8a2-f0215753c05f is going to be updated. [ 1286.641091] env[65630]: DEBUG networking_nsxv3.common.locking [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.641371] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.641500] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.641913] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.642134] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.642372] env[65630]: DEBUG oslo_concurrency.lockutils [None req-e33cc7a8-0c24-4bce-9bc0-cf76e02435e4 None None] Releasing lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.679845] env[65630]: INFO networking_nsxv3.common.synchronization [req-d96fb889-6af0-4a27-b47d-585319c5f912 req-60666941-7825-4680-a6a3-4c3e0a53c3d3 tempest-InstanceActionsV221TestJSON-967487894 tempest-InstanceActionsV221TestJSON-967487894-project-member] Enqueued Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_members [ 1286.680424] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGHEST for action security_group_members [ 1286.680734] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.680908] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.680995] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.681218] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.681385] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.681465] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.681527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.681678] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.681764] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.681891] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.183990] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.184383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.184383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.184569] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.184669] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.184880] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.184981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.185050] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.185208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.185287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.185374] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 is going to be updated. [ 1287.212229] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.212229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.212229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.212527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.212527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.220935] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 in Status: IN_PROGRESS for 2s [ 1287.366867] env[65630]: INFO networking_nsxv3.common.synchronization [req-c8f4cb51-0e70-4c64-9915-b6d33b0d5728 req-804ffa55-97a9-4b69-b223-9dcad062ace9 service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 1287.367169] env[65630]: INFO networking_nsxv3.common.synchronization [req-c8f4cb51-0e70-4c64-9915-b6d33b0d5728 req-804ffa55-97a9-4b69-b223-9dcad062ace9 service nova] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1287.367396] env[65630]: INFO networking_nsxv3.common.synchronization [req-c8f4cb51-0e70-4c64-9915-b6d33b0d5728 req-804ffa55-97a9-4b69-b223-9dcad062ace9 service nova] Enqueued Resource ID: cc17cda7-fd03-4178-a8a2-f0215753c05f with Priority: HIGHEST for action port [ 1287.368029] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_rules [ 1287.368208] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1287.368384] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc17cda7-fd03-4178-a8a2-f0215753c05f with Priority: HIGHEST for action port [ 1287.368724] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.368907] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.369028] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.369303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.369489] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.370900] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.371360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.371360] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.371540] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.371991] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.371991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.371991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.372186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.373180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.373447] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.374223] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc17cda7-fd03-4178-a8a2-f0215753c05f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.374223] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.374374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.374455] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.374517] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc17cda7-fd03-4178-a8a2-f0215753c05f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.567500] env[65630]: INFO networking_nsxv3.common.synchronization [req-c1f244a5-a3b4-49e6-94f1-019cb2bb8fe6 req-e71a3f15-5ab1-4e46-b821-b62f2136f590 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1287.568373] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1287.568524] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.568593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.568660] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.568852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.569013] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.569558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.569558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.569558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.569558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.569558] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.876906] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.877051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.877243] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.878189] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc17cda7-fd03-4178-a8a2-f0215753c05f with status ACTIVE [ 1287.878347] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.878503] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.878668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.878730] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.878855] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.879387] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.879387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.879387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.879387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.879387] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.879696] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.879696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.879696] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.879875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.879875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.879950] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc17cda7-fd03-4178-a8a2-f0215753c05f is going to be updated. [ 1287.902484] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.902661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.902702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.902889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.903061] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.903191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc17cda7-fd03-4178-a8a2-f0215753c05f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.072220] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.072435] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.072515] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.072801] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.072924] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.073661] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.073661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.073661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.073661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.073661] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.073661] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1288.105241] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.105398] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.105469] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.105666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.105804] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.116533] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1288.381734] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.884792] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.885090] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.885242] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.885571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.885690] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.885797] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1288.912415] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.912612] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.912659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.913699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.913699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.922943] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1289.231020] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 in Status: SUCCESS [ 1289.231320] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 deletion is rescheduled due to dependency. [ 1289.231491] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.127649] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1290.128055] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 deletion is rescheduled due to dependency. [ 1290.128055] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.933249] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1290.933545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.934144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.934144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.934144] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.934370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.934370] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.934448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.934524] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.934613] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.934694] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.437035] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.941021] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 397b25ae-6929-46ce-8711-37502e4943b3: rpc.has_security_group_logging(os_id): False [ 1291.964060] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.964305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.964305] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.964565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.964663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.964932] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.965128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.965191] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.965345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.965445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.965564] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1292.076144] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.076290] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.076371] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.076736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.076897] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.099053] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1292.569027] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1292.569027] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1294.119560] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1294.119858] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.570329] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.570567] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1297.880523] env[65630]: INFO networking_nsxv3.common.synchronization [req-5de736ee-3820-4fa8-8dad-b8c2e5bd7c63 req-67061d77-34af-4070-97c8-9e1f399ee7d7 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1297.880700] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1297.881008] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.881143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.881210] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.881417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.881596] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.882243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.882243] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.882324] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.882359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.882454] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.192882] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.193163] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.193292] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.193589] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.193940] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.194157] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.194288] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.194701] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.194893] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.195171] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.195560] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1298.195695] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1298.195804] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1298.195926] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.196036] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1298.196173] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1298.220729] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1298.220729] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1298.220729] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1298.220729] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-390" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.221337] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.221337] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.221533] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.221851] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.222065] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3eac0a-9f1a-4534-9eff-16e540a7ff75',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.385426] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.385632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.385632] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.385771] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.385864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.386081] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.386183] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.386248] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.386405] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.386490] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.386593] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1298.412898] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.413056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.413128] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.413328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.413464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.422099] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1298.724847] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.724847] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.725405] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.725850] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.726057] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.726230] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 3e3eac0a-9f1a-4534-9eff-16e540a7ff75 not found, creating... [ 1298.726527] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.726701] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.726826] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.727082] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.727225] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.727520] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.727673] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.727828] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.728084] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.728227] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.728371] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 3e3eac0a-9f1a-4534-9eff-16e540a7ff75 is going to be created. [ 1298.749847] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.750080] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.750207] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.750483] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.750706] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.750931] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.456248] env[65630]: INFO networking_nsxv3.common.synchronization [req-5de736ee-3820-4fa8-8dad-b8c2e5bd7c63 req-27679d6e-736e-48b8-afc4-aa7ae4a6c2b1 service nova] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 1299.456248] env[65630]: INFO networking_nsxv3.common.synchronization [req-5de736ee-3820-4fa8-8dad-b8c2e5bd7c63 req-27679d6e-736e-48b8-afc4-aa7ae4a6c2b1 service nova] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1299.456248] env[65630]: INFO networking_nsxv3.common.synchronization [req-5de736ee-3820-4fa8-8dad-b8c2e5bd7c63 req-27679d6e-736e-48b8-afc4-aa7ae4a6c2b1 service nova] Enqueued Resource ID: 3e3eac0a-9f1a-4534-9eff-16e540a7ff75 with Priority: HIGHEST for action port [ 1299.456248] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_rules [ 1299.456827] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1299.457209] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3eac0a-9f1a-4534-9eff-16e540a7ff75 with Priority: HIGHEST for action port [ 1299.457748] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.458013] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.458178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.458481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.458671] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.460421] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.460941] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.461295] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.461921] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.462114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.462383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.462566] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3eac0a-9f1a-4534-9eff-16e540a7ff75',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.961099] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.961526] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.964812] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e3eac0a-9f1a-4534-9eff-16e540a7ff75 with status ACTIVE [ 1299.965128] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.965300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.965385] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.965663] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.965768] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.966050] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.966161] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.966204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.966724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.966724] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.966837] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.966891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.967333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.967333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.967333] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.967333] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e3eac0a-9f1a-4534-9eff-16e540a7ff75 is going to be updated. [ 1299.994327] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.994555] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.994658] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.994891] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.995099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.995273] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3eac0a-9f1a-4534-9eff-16e540a7ff75" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.094025] env[65630]: INFO networking_nsxv3.common.synchronization [req-08e5b108-b9d8-48a2-866b-f296c018e7e1 req-661fdbee-4aac-4b02-bd47-973de59740b7 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1300.094379] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1300.095042] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.095042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.095042] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.095384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.095384] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.095384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.095384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.095384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.096226] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.096226] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.414709] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.414898] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.415027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.415287] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.415541] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.415701] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.415813] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.416031] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.416173] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.416399] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1300.416476] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1300.416605] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1300.416714] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1300.416819] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1300.416918] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1300.417056] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1300.437170] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1300.437373] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1300.437515] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1300.437688] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-240" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.437995] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.438179] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.438337] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.438662] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.438808] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.440548] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1300.440548] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 deletion is rescheduled due to dependency. [ 1300.440548] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.440802] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.441862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.441862] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.441862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.441862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.441862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.441862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.441862] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.598424] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.944014] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.944277] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.944441] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.944741] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.944903] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.945061] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port 27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 not found, creating... [ 1300.945326] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.945485] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.945602] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.945824] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.945958] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.946254] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.946459] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.946628] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.946877] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.947028] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.947188] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: 27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 is going to be created. [ 1300.948316] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.968804] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.969308] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.969308] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.969477] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.969716] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.969921] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.101019] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.452459] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.605019] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.605019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.605019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.605019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.605019] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.605019] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d is going to be updated. [ 1301.644129] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.644129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.644129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.644314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.644352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.655148] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: IN_PROGRESS for 2s [ 1301.693352] env[65630]: INFO networking_nsxv3.common.synchronization [req-08e5b108-b9d8-48a2-866b-f296c018e7e1 req-bd929b71-b049-4585-bece-87446b32abf5 service nova] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 1301.693352] env[65630]: INFO networking_nsxv3.common.synchronization [req-08e5b108-b9d8-48a2-866b-f296c018e7e1 req-bd929b71-b049-4585-bece-87446b32abf5 service nova] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1301.693352] env[65630]: INFO networking_nsxv3.common.synchronization [req-08e5b108-b9d8-48a2-866b-f296c018e7e1 req-bd929b71-b049-4585-bece-87446b32abf5 service nova] Enqueued Resource ID: 27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 with Priority: HIGHEST for action port [ 1301.693352] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_rules [ 1301.693352] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1301.693352] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 with Priority: HIGHEST for action port [ 1301.693352] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.693352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.693352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.693352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.693352] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.694082] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.694082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.694082] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.694082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.694082] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.694280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.694280] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.954463] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.954671] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.954810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.955152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.955376] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.955464] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1301.984966] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.984966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.985412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.985412] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.985488] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.995512] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1302.196476] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.196697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.196834] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 with status ACTIVE [ 1302.196997] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.197121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.197189] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.197453] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.197693] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.197807] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.198216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.198216] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.198331] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.198417] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.198577] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.198662] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.198723] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.198870] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.198948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.199045] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615 is going to be updated. [ 1302.219785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.219958] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.220051] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.220260] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.220393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.220622] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27b8c4aa-e1f3-48f0-a4f6-d9c12b65a615" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.667983] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: SUCCESS [ 1303.668424] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.668631] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.668982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.669298] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.669466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.669534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.669749] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.669943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.670069] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.007392] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1304.007919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.007919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.008108] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.008460] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.008551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.008551] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.008797] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.008878] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.008960] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.009083] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.063724] env[65630]: INFO networking_nsxv3.common.synchronization [req-a140d96b-8124-4e42-bbeb-134bb4fb0c49 req-deda5521-32d2-48d7-ace9-339c54265353 tempest-ServerActionsTestOtherB-476283146 tempest-ServerActionsTestOtherB-476283146-project-member] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1304.064617] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGHEST for action security_group_members [ 1304.064617] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.064737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.064737] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.064918] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.065086] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.065184] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.065245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.065393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.065476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.065569] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.172502] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.511805] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.568627] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.569012] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.569115] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.569399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.569493] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.569733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.569864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.569940] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.570132] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.570237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.570338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be updated. [ 1304.599489] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.599876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.599876] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.600049] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.600181] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.610478] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: IN_PROGRESS for 2s [ 1304.675023] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.015046] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bee721e8-67ba-4959-8884-95efeb9d52b8: rpc.has_security_group_logging(os_id): False [ 1305.034651] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.034840] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.034899] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.035167] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.035342] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.035748] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.035922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.035922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.036299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.036299] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.036299] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1305.097138] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.097374] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.097427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.097666] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.097841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.115588] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1305.178159] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.178159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.178159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.178159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.178159] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.178159] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d is going to be updated. [ 1305.217332] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.217565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.217565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.217805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.217947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.230896] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: IN_PROGRESS for 2s [ 1306.623629] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 397b25ae-6929-46ce-8711-37502e4943b3 in Status: SUCCESS [ 1306.624046] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 deletion is rescheduled due to dependency. [ 1306.624046] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.131546] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1307.131546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.243237] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: SUCCESS [ 1307.243572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.243874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.244283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.244608] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.244841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.244914] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.245203] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.245294] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.245481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.245580] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.748635] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.250928] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 636d8397-05bf-4fff-8f28-4b4ded6b5b5d: rpc.has_security_group_logging(os_id): False [ 1308.269999] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.270204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.270256] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.270448] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.290173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.290506] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.290630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.290699] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.291036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.291036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.291168] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d is going to be updated. [ 1308.360160] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.360322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.360402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.360591] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.360745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.377222] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: IN_PROGRESS for 2s [ 1308.659856] env[65630]: INFO networking_nsxv3.common.synchronization [req-31175d50-4231-4048-9293-a3b93f111fa8 req-414e1b1a-327b-42b5-98ec-549bcec55607 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_members [ 1308.660762] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ff777-134b-424f-a605-d1ecbc661b35 with Priority: HIGHEST for action security_group_members [ 1308.661909] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-412ff777-134b-424f-a605-d1ecbc661b35 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.662056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.662129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.662328] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.662486] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.662582] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.662642] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.662792] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.662879] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.662973] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('412ff777-134b-424f-a605-d1ecbc661b35',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.167852] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.168264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.168264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.168354] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.168461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.168740] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.168843] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.168946] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.169202] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.169338] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.169456] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 412ff777-134b-424f-a605-d1ecbc661b35 is going to be updated. [ 1309.197926] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.198143] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.198233] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.198477] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.198702] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.207689] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 412ff777-134b-424f-a605-d1ecbc661b35 in Status: IN_PROGRESS for 2s [ 1310.389741] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: SUCCESS [ 1310.390137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.218096] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 412ff777-134b-424f-a605-d1ecbc661b35 in Status: SUCCESS [ 1311.218096] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 412ff777-134b-424f-a605-d1ecbc661b35 deletion is rescheduled due to dependency. [ 1311.218322] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-412ff777-134b-424f-a605-d1ecbc661b35" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.662123] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.662123] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.699035] env[65630]: INFO networking_nsxv3.common.synchronization [None req-18f88a39-b21c-4c39-af51-6de332fe8495 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_rules [ 1313.699316] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_rules [ 1313.699714] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.699780] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.699820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.700137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.700245] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.786332] env[65630]: INFO networking_nsxv3.common.synchronization [None req-c0d6a185-5725-46bf-a492-d9c716fef56a tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_rules [ 1313.787043] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_rules [ 1313.787509] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.787688] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.221835] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.222111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.222111] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.222280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.222369] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.222467] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 already deleted. [ 1314.222550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.222701] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.222853] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.222935] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.746069] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.746069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.746069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.746069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.746069] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.746069] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 already deleted. [ 1314.746597] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.788812] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.788812] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.777441] env[65630]: INFO networking_nsxv3.common.synchronization [req-aafbd5e7-e453-4e52-930b-b73aad95e6ae req-97e30642-4a71-4ec5-85e2-0f4c7c643cc5 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_members [ 1319.777823] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_members [ 1319.778165] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.778291] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.778365] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.778603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.778796] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.778901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.778901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.779089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.779179] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.779236] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.091942] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.091942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.091942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.091942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.091942] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.091942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.091942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.091942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.091942] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.092644] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1320.092644] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] NeedRegenerationException {{(pid=65630) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1320.092644] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] no value, waiting for create lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1320.092644] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] value creation lock acquired {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1320.092783] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] No value present for key: 'zone-id' {{(pid=65630) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1320.092877] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Calling creation function for not-yet-present value {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1320.093042] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1320.118899] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1320.119092] env[65630]: DEBUG dogpile.cache.region [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65630) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1320.119245] env[65630]: DEBUG dogpile.lock [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Released creation lock {{(pid=65630) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1320.119419] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "network-772" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.119735] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed taken with stack trace [, , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.119908] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.120038] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.120355] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.120493] env[65630]: DEBUG networking_nsxv3.api.rpc [None req-17e26951-35a3-4f59-97f4-965054933952 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.281796] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.282047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.282047] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.282264] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.282359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.282560] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.282659] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.282725] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.282885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.282959] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.283057] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 already deleted. [ 1320.283140] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.623189] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.623426] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.623550] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.623935] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.624196] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.624363] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Segment Port bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed not found, creating... [ 1320.624741] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.624910] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.625027] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.625333] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.625446] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.625708] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.625895] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.626030] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.626262] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.626423] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.626581] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Resource: SegmentPort with ID: bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed is going to be created. [ 1320.648925] env[65630]: DEBUG networking_nsxv3.common.locking [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.649247] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.649366] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.649780] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.650087] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.650342] env[65630]: DEBUG oslo_concurrency.lockutils [None req-17e26951-35a3-4f59-97f4-965054933952 None None] Releasing lock "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.334570] env[65630]: INFO networking_nsxv3.common.synchronization [req-aafbd5e7-e453-4e52-930b-b73aad95e6ae req-543b33be-d663-465e-9788-4ee95161576c service nova] Enqueued Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_rules [ 1321.334570] env[65630]: INFO networking_nsxv3.common.synchronization [req-aafbd5e7-e453-4e52-930b-b73aad95e6ae req-543b33be-d663-465e-9788-4ee95161576c service nova] Enqueued Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_members [ 1321.334570] env[65630]: INFO networking_nsxv3.common.synchronization [req-aafbd5e7-e453-4e52-930b-b73aad95e6ae req-543b33be-d663-465e-9788-4ee95161576c service nova] Enqueued Resource ID: bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed with Priority: HIGHEST for action port [ 1321.334570] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_rules [ 1321.334570] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_members [ 1321.335334] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed with Priority: HIGHEST for action port [ 1321.335786] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.336130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.336289] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.336570] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.336821] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.337875] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.338123] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.338286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.338546] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.338794] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.339010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.339513] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.340125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.341178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.341178] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.342922] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.342922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.342922] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.343149] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.343149] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.845371] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.845545] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.845686] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.846647] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed with status ACTIVE [ 1321.846891] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.847032] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.847109] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.847325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.847433] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.848025] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.848025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.848025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.848025] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.848285] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.848340] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.848466] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.848531] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.848670] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.848745] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.848831] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed is going to be updated. [ 1321.871686] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.871887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.871887] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.872162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.872303] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.872461] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bec8e516-1c9e-433f-b1e6-0dd3b8cf67ed" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.351513] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.853623] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.853874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.853874] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.854079] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.854180] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.854281] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 is going to be created. [ 1322.877602] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.877860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.877860] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.878054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.878217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.888066] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: UNINITIALIZED for 2s [ 1324.899939] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: SUCCESS [ 1324.900217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.900511] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.900587] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.900770] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.900943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.900943] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.901114] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.901197] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.901283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.901375] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.404175] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.907466] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49365f80-fea1-4561-bc96-ccf6a8f207c1: rpc.has_security_group_logging(os_id): False [ 1325.936642] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.936861] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.936919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.937125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.937217] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.937464] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.937562] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.937626] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.937778] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.937852] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.937938] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 is going to be created. [ 1326.002768] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.002993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.002993] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.003212] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.003393] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.018509] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: IN_PROGRESS for 2s [ 1326.336604] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.336604] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1328.032394] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: SUCCESS [ 1328.032676] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.307859] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.308062] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.308130] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.308361] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.308469] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.811275] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.313122] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.815434] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1329.815545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1330.641473] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.641903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.641903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.641903] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.653270] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1330.655054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.656148] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1330.695998] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.696238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.696238] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.696411] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.710981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.711784] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1330.711923] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1330.711972] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1330.753157] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.753399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.753399] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.753573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.754820] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.755037] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1330.824685] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.824952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.824952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.825138] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.825496] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.825801] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1330.905889] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.906056] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.906117] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.906329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.906638] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.906991] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1330.907102] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'397b25ae-6929-46ce-8711-37502e4943b3', 'd0f42bcf-1192-403d-b71c-67a606089c6b', '59e543f5-3a08-4982-8918-ea2593f725ef', 'a8ae8320-e1e0-4786-a4ef-76ef36da2f81', '022a54ae-7f58-4ca4-ad58-e1f8c8343cd1', 'adaa915d-681a-4aa6-acf8-0488514134f3', '49365f80-fea1-4561-bc96-ccf6a8f207c1', '201b4cc2-0baa-4c4b-b457-1bb173e25095', '66073fc6-c410-4bfa-8cca-8f91f86be7d3', '6a30c8a0-56ed-49c0-9575-ac779408f52f', '0e647f36-5543-4052-8cd2-b972c5bc69c3', '9b88cc7d-8b33-4bc2-ab6f-d06d46602783', '8a871646-acc8-47a5-a5e8-6672ff7eb295', 'ce9a5258-fb15-458a-b6e3-3ed66efd5ab1', '00ac0e45-8fb0-4a0b-aeee-053765768653', 'd30328a0-3fe7-4b9c-8fb4-3748bb068910', 'b71bd905-a59a-420e-96dc-4f48e2b11e86', '250f01a9-6e9d-4438-a22e-10b77875cd34', 'a5d959e5-8b2a-40d2-918d-da1d80daa362', 'd84857eb-b557-4aa2-8d62-34137b9cab1f', '260959d6-44de-432d-a8ee-ce634ff440ed', 'dcabb3c1-63c7-4e6e-99e0-7cb17896f367', '3f6b8a5b-bd24-49ea-96d6-51163d266deb', 'b40b1ce8-5c01-4d56-90e0-a1525f7d2d4d', '34ac1819-3d29-4b4e-ac83-e39408cd6e49', '313d0c55-f8bb-4559-9f42-dfae7678f0bc', 'e8db9dba-41a6-4390-8a03-e9d1a073b831', '29cd0e69-d83a-4e99-940e-3b95d8bf9b2d', '9ed098d0-aa55-4a88-be4f-3fe063ee74f6', '24ebd7ab-0776-4822-9b99-4e4b98571494', 'd4010c2f-2754-4e2d-949f-ec21a2348a3d', '14b62121-4e0b-44ce-9aab-8ed6b4024ea4', '57e44ebf-431f-48ef-9d59-768d3bda2cbd', '636d8397-05bf-4fff-8f28-4b4ded6b5b5d', '0b25fb6e-f742-4dda-bb8b-ad33a402286e', 'f3c09c32-a206-4c5b-9a2a-99cacfd18ac7', '412ff777-134b-424f-a605-d1ecbc661b35', 'bee721e8-67ba-4959-8884-95efeb9d52b8', '6f9d43bc-6007-4e6a-81c6-321db263b170', 'f69e9012-529a-49ae-80ce-87883c1f49fe'} {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1330.907197] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1330.946778] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.947078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.947078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.947246] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.947329] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.947435] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1330.947501] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1330.947570] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1331.027706] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.027942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.027942] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.028219] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.029427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.029737] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1331.029819] env[65630]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65630) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1331.029894] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1331.029962] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1331.030054] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1331.030129] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGH for action security_group_rules [ 1331.030206] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGH for action security_group_rules [ 1331.030271] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGH for action security_group_rules [ 1331.030333] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGH for action security_group_rules [ 1331.030394] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGH for action security_group_rules [ 1331.030455] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGH for action security_group_rules [ 1331.030515] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGH for action security_group_rules [ 1331.030587] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGH for action security_group_rules [ 1331.030649] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGH for action security_group_rules [ 1331.030710] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGH for action security_group_rules [ 1331.030770] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGH for action security_group_rules [ 1331.030841] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGH for action security_group_rules [ 1331.030926] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGH for action security_group_rules [ 1331.030992] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGH for action security_group_rules [ 1331.031066] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGH for action security_group_rules [ 1331.031127] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGH for action security_group_rules [ 1331.031189] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGH for action security_group_rules [ 1331.031245] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGH for action security_group_rules [ 1331.031308] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGH for action security_group_rules [ 1331.031368] env[65630]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGH for action security_group_rules [ 1331.031464] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.337432] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.337675] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1331.337675] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397b25ae-6929-46ce-8711-37502e4943b3 with Priority: HIGH for action security_group_rules [ 1331.337834] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e543f5-3a08-4982-8918-ea2593f725ef with Priority: HIGH for action security_group_rules [ 1331.337904] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGH for action security_group_rules [ 1331.338027] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 with Priority: HIGH for action security_group_rules [ 1331.338128] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84857eb-b557-4aa2-8d62-34137b9cab1f with Priority: HIGH for action security_group_rules [ 1331.338234] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 with Priority: HIGH for action security_group_rules [ 1331.338325] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 with Priority: HIGH for action security_group_rules [ 1331.338413] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 with Priority: HIGH for action security_group_rules [ 1331.338505] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 with Priority: HIGH for action security_group_rules [ 1331.338593] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 with Priority: HIGH for action security_group_rules [ 1331.338680] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 with Priority: HIGH for action security_group_rules [ 1331.338766] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 with Priority: HIGH for action security_group_rules [ 1331.338851] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 with Priority: HIGH for action security_group_rules [ 1331.338938] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f with Priority: HIGH for action security_group_rules [ 1331.339031] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 with Priority: HIGH for action security_group_rules [ 1331.339126] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adaa915d-681a-4aa6-acf8-0488514134f3 with Priority: HIGH for action security_group_rules [ 1331.339219] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 with Priority: HIGH for action security_group_rules [ 1331.339329] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 with Priority: HIGH for action security_group_rules [ 1331.339428] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f42bcf-1192-403d-b71c-67a606089c6b with Priority: HIGH for action security_group_rules [ 1331.339528] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 with Priority: HIGH for action security_group_rules [ 1331.339897] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-397b25ae-6929-46ce-8711-37502e4943b3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.340045] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.340110] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.340325] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.340406] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('397b25ae-6929-46ce-8711-37502e4943b3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.341446] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59e543f5-3a08-4982-8918-ea2593f725ef taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.341567] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.341636] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.341789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.341870] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59e543f5-3a08-4982-8918-ea2593f725ef',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.342738] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.342892] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.342997] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.343440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.343440] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.344733] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00ac0e45-8fb0-4a0b-aeee-053765768653 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.344733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.344733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.344901] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.344976] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00ac0e45-8fb0-4a0b-aeee-053765768653',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.345749] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d84857eb-b557-4aa2-8d62-34137b9cab1f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.345864] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.346018] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.346093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.346149] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d84857eb-b557-4aa2-8d62-34137b9cab1f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.346821] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5d959e5-8b2a-40d2-918d-da1d80daa362 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.346945] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.347034] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.347173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.347270] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5d959e5-8b2a-40d2-918d-da1d80daa362',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.347913] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f01a9-6e9d-4438-a22e-10b77875cd34 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.348084] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.348158] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.348308] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.348403] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f01a9-6e9d-4438-a22e-10b77875cd34',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.349307] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71bd905-a59a-420e-96dc-4f48e2b11e86 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.349475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.349558] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.349805] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.349960] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71bd905-a59a-420e-96dc-4f48e2b11e86',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.350609] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.350776] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.350838] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.350992] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.351115] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce9a5258-fb15-458a-b6e3-3ed66efd5ab1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.351732] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.351867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.351916] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.352054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.352137] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d30328a0-3fe7-4b9c-8fb4-3748bb068910',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.352794] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a871646-acc8-47a5-a5e8-6672ff7eb295 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.352889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.352948] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.353112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.353179] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a871646-acc8-47a5-a5e8-6672ff7eb295',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.353943] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.354093] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.354231] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.354298] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.354365] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b88cc7d-8b33-4bc2-ab6f-d06d46602783',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.355110] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e647f36-5543-4052-8cd2-b972c5bc69c3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.355245] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.355313] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.355428] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.355494] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e647f36-5543-4052-8cd2-b972c5bc69c3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.356171] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a30c8a0-56ed-49c0-9575-ac779408f52f taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.356272] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.356377] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.356565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.356565] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a30c8a0-56ed-49c0-9575-ac779408f52f',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.357334] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.357481] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.357529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.357643] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.357704] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66073fc6-c410-4bfa-8cca-8f91f86be7d3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.358449] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adaa915d-681a-4aa6-acf8-0488514134f3 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.358564] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.358610] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.358816] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.359214] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adaa915d-681a-4aa6-acf8-0488514134f3',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.360475] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-201b4cc2-0baa-4c4b-b457-1bb173e25095 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.360617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.360687] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.360841] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.360915] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('201b4cc2-0baa-4c4b-b457-1bb173e25095',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.361679] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.361813] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.361865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.362009] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.362076] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('022a54ae-7f58-4ca4-ad58-e1f8c8343cd1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.363155] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0f42bcf-1192-403d-b71c-67a606089c6b taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.363155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.363155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.363155] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.363155] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0f42bcf-1192-403d-b71c-67a606089c6b',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.363882] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.364010] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.364395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.364395] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.364395] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8ae8320-e1e0-4786-a4ef-76ef36da2f81',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.391716] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.391862] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.391927] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.392122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.394447] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.394584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.395342] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.395480] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.413304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.413444] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59e543f5-3a08-4982-8918-ea2593f725ef is going to be deleted. [ 1331.414347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.414559] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.439346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.439512] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 397b25ae-6929-46ce-8711-37502e4943b3 is going to be deleted. [ 1331.440726] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.440952] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.463888] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.464114] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00ac0e45-8fb0-4a0b-aeee-053765768653 is going to be deleted. [ 1331.480172] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.480382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.480382] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.480556] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.480647] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.480766] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59e543f5-3a08-4982-8918-ea2593f725ef" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.494317] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.494510] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.494617] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.494919] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.495074] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.495255] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-397b25ae-6929-46ce-8711-37502e4943b3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.516499] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.516720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.516720] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.517036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.517152] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.517287] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00ac0e45-8fb0-4a0b-aeee-053765768653" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.877441] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.877834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.877834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.877834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.878064] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.878122] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.878162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.878301] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.878383] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.878476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.878586] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.945431] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.945673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.945789] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.946106] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.955848] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.956065] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.957502] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.957698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.959677] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.959825] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.961395] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.961538] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.963328] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.963489] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.964571] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.964686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.965702] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.965830] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.966905] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.967078] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.968074] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.968205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.969296] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.969430] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.970259] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.970829] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.970970] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.971773] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.972270] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.972392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.973166] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.973640] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.973770] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.974653] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.975201] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.975304] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.976085] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.976597] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.976736] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.980166] env[65630]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.980566] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.980702] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a30c8a0-56ed-49c0-9575-ac779408f52f is going to be deleted. [ 1331.981608] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.981822] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.999472] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.999613] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d30328a0-3fe7-4b9c-8fb4-3748bb068910 is going to be deleted. [ 1332.000463] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.000673] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.020394] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.020545] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 201b4cc2-0baa-4c4b-b457-1bb173e25095 is going to be deleted. [ 1332.021498] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.021733] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.037634] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.037871] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.042265] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.042412] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce9a5258-fb15-458a-b6e3-3ed66efd5ab1 is going to be deleted. [ 1332.043381] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.043596] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.066703] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.066982] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.078170] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.078359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.079276] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.079344] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f01a9-6e9d-4438-a22e-10b77875cd34 is going to be deleted. [ 1332.080207] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.080418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.131658] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.131865] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.139208] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.139365] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d84857eb-b557-4aa2-8d62-34137b9cab1f is going to be deleted. [ 1332.140364] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.140630] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.195832] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.196078] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 022a54ae-7f58-4ca4-ad58-e1f8c8343cd1 is going to be deleted. [ 1332.197137] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.197426] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.215606] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.215817] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.242518] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.242649] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.244593] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.244652] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a871646-acc8-47a5-a5e8-6672ff7eb295 is going to be deleted. [ 1332.245803] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.246029] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.335628] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.335824] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adaa915d-681a-4aa6-acf8-0488514134f3 is going to be deleted. [ 1332.336810] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.337077] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.373565] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.373774] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b88cc7d-8b33-4bc2-ab6f-d06d46602783 is going to be deleted. [ 1332.374665] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.374884] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.382885] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.383083] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.390343] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.390509] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.390957] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.442277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.442419] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5d959e5-8b2a-40d2-918d-da1d80daa362 is going to be deleted. [ 1332.443359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.443573] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.445020] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.445283] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.482478] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.482663] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66073fc6-c410-4bfa-8cca-8f91f86be7d3 is going to be deleted. [ 1332.483603] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.483818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.519646] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.519913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.521135] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.521314] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.526682] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.526938] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e647f36-5543-4052-8cd2-b972c5bc69c3 is going to be deleted. [ 1332.528054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.528335] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.580427] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.580709] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8ae8320-e1e0-4786-a4ef-76ef36da2f81 is going to be deleted. [ 1332.581572] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.581807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.758960] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.759182] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.778319] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.778509] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71bd905-a59a-420e-96dc-4f48e2b11e86 is going to be deleted. [ 1332.779440] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.779677] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.817786] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.818016] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0f42bcf-1192-403d-b71c-67a606089c6b is going to be deleted. [ 1332.818875] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.819112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.819225] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.819359] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a30c8a0-56ed-49c0-9575-ac779408f52f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.819523] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.819691] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.819769] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.819889] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d30328a0-3fe7-4b9c-8fb4-3748bb068910" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.820441] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.820599] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.820700] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.820818] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-201b4cc2-0baa-4c4b-b457-1bb173e25095" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.820947] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.821144] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.821229] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.821345] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce9a5258-fb15-458a-b6e3-3ed66efd5ab1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.821476] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.821621] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.821697] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.821807] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f01a9-6e9d-4438-a22e-10b77875cd34" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.821933] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.822089] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.822166] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.822277] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d84857eb-b557-4aa2-8d62-34137b9cab1f" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.822402] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.822542] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.822618] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.822728] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-022a54ae-7f58-4ca4-ad58-e1f8c8343cd1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.822849] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.822985] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.823091] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.823211] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a871646-acc8-47a5-a5e8-6672ff7eb295" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.823336] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.823475] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.823550] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.823655] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adaa915d-681a-4aa6-acf8-0488514134f3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.823777] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.823913] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.823989] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.824112] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b88cc7d-8b33-4bc2-ab6f-d06d46602783" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.824237] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.824375] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.824447] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.824563] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5d959e5-8b2a-40d2-918d-da1d80daa362" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.824686] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.824859] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.824955] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.825080] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66073fc6-c410-4bfa-8cca-8f91f86be7d3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.839602] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.839812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.839812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.840036] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.840131] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.840249] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e647f36-5543-4052-8cd2-b972c5bc69c3" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.864658] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.864931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.864931] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.865178] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.865286] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.865418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71bd905-a59a-420e-96dc-4f48e2b11e86" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.890458] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.890890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.890890] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.890981] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.891066] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.891192] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8ae8320-e1e0-4786-a4ef-76ef36da2f81" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.893607] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49365f80-fea1-4561-bc96-ccf6a8f207c1: rpc.has_security_group_logging(os_id): False [ 1332.932575] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.932811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.932811] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.933014] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.967954] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.968172] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.994694] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.995063] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.995173] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.995236] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.995445] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.995529] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.995617] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 is going to be updated. [ 1332.996834] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.997068] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.997164] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.997284] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0f42bcf-1192-403d-b71c-67a606089c6b" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.113746] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.113954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.113954] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.114129] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.114279] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.128384] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: IN_PROGRESS for 2s [ 1335.144011] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: SUCCESS [ 1335.144362] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.340692] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.341113] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.342232] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.342524] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.343335] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.343724] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.344403] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.344764] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1356.345947] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.346365] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.251983] env[65630]: INFO networking_nsxv3.common.synchronization [req-61fdebdc-2bf8-4ad6-9c76-4562838b87ef req-001d6ed8-2b49-4fca-b0ca-dcb3396d3e04 tempest-ServerActionsTestJSON-1101009893 tempest-ServerActionsTestJSON-1101009893-project-member] Enqueued Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1359.252767] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee721e8-67ba-4959-8884-95efeb9d52b8 with Priority: HIGHEST for action security_group_members [ 1359.253133] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-bee721e8-67ba-4959-8884-95efeb9d52b8 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.253261] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.253347] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.253592] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.253764] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.253881] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.253963] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.254186] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.254300] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.254407] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bee721e8-67ba-4959-8884-95efeb9d52b8',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.759695] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.759930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.759930] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.760162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.790727] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.790990] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.791125] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.791185] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.791392] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.791471] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.791559] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 is going to be updated. [ 1359.823785] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.823926] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.823991] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.824205] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.824344] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.833402] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: IN_PROGRESS for 2s [ 1361.845093] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bee721e8-67ba-4959-8884-95efeb9d52b8 in Status: SUCCESS [ 1361.845366] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bee721e8-67ba-4959-8884-95efeb9d52b8 deletion is rescheduled due to dependency. [ 1361.845431] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bee721e8-67ba-4959-8884-95efeb9d52b8" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.254180] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.254546] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.255843] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.256236] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.380118] env[65630]: INFO networking_nsxv3.common.synchronization [req-0f1eee9e-e59e-4292-ae63-18f23732a896 req-d2d5b446-b574-424c-a823-8fe7fce35990 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1371.380686] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1371.380987] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.381121] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.381350] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.381416] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.381525] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.381619] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.381679] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.381821] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.381905] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.381993] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.884070] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.386323] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.889493] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.889722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.889722] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.889877] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.889966] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.890080] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d is going to be updated. [ 1372.918603] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.918824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.918824] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.919054] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.919204] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.928861] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: IN_PROGRESS for 2s [ 1374.940338] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: SUCCESS [ 1374.940738] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.381457] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.381817] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.382245] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.382600] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.775542] env[65630]: INFO networking_nsxv3.common.synchronization [req-07563007-f5ac-405b-97f5-bbd8322928e2 req-99ec8198-9181-434f-9985-9564f085bd71 tempest-AttachVolumeNegativeTest-1096230509 tempest-AttachVolumeNegativeTest-1096230509-project-member] Enqueued Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_members [ 1382.776094] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 with Priority: HIGHEST for action security_group_members [ 1382.776408] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-49365f80-fea1-4561-bc96-ccf6a8f207c1 taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.776534] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.776595] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.777165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.777165] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.777165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.777165] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.777528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.777528] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.777528] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49365f80-fea1-4561-bc96-ccf6a8f207c1',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.279840] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.280188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.280188] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.280457] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.280607] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.280884] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.281041] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.281162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.281384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.281501] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.281645] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 is going to be updated. [ 1383.311093] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.311384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.311384] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.311527] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.311652] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.319855] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: IN_PROGRESS for 2s [ 1385.330774] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 in Status: SUCCESS [ 1385.331162] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49365f80-fea1-4561-bc96-ccf6a8f207c1 deletion is rescheduled due to dependency. [ 1385.331162] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49365f80-fea1-4561-bc96-ccf6a8f207c1" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.686289] env[65630]: INFO networking_nsxv3.common.synchronization [req-cfd4eccc-2eab-4558-a680-62a10e4facf2 req-4943f512-69ca-4743-96ac-e5453db9bac1 tempest-ServerActionsTestOtherA-115228109 tempest-ServerActionsTestOtherA-115228109-project-member] Enqueued Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1387.686838] env[65630]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d with Priority: HIGHEST for action security_group_members [ 1387.687157] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d taken with stack trace [, , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.687280] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.687346] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.687571] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.687770] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.687847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.687885] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.688609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.688609] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.688609] env[65630]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('636d8397-05bf-4fff-8f28-4b4ded6b5b5d',) {} {{(pid=65630) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.190617] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.190847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.190847] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.191099] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.217812] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.218071] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.218196] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.218352] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.218584] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.218668] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.218826] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d is going to be updated. [ 1388.248184] env[65630]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65630) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.248357] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.248418] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.248698] env[65630]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.248867] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.258180] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: IN_PROGRESS for 2s [ 1390.270217] env[65630]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d in Status: SUCCESS [ 1390.270602] env[65630]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 636d8397-05bf-4fff-8f28-4b4ded6b5b5d deletion is rescheduled due to dependency. [ 1390.270602] env[65630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-636d8397-05bf-4fff-8f28-4b4ded6b5b5d" {{(pid=65630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.687793] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.688169] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.688960] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.689285] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.689901] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.690307] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.690840] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.691239] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.691931] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.692372] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.692875] env[65630]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.693271] env[65630]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0